-- Logs begin at Wed 2021-04-21 13:59:22 UTC, end at Wed 2021-04-21 15:03:23 UTC. -- Apr 21 14:29:34.420344 dv-cinder-786385-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 21 14:29:34.428599 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Apr 21 14:29:34 2021] *** Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: nodename: dv-cinder-786385-2-iscsi Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: machine: x86_64 Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: clock source: unix Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: pcre jit disabled Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: detected number of CPU cores: 4 Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: current working directory: / Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: detected binary path: /usr/bin/uwsgi-core Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: dropping root privileges as early as possible Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: your processes number limit is 47843 Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: your memory page size is 4096 bytes Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: detected max file descriptor number: 2048 Apr 21 14:29:34.430752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: lock engine: pthread robust mutexes Apr 21 14:29:34.431928 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: thunder lock: enabled Apr 21 14:29:34.431928 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 21 14:29:34.431928 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: dropping root privileges after socket binding Apr 21 14:29:34.431928 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 21 14:29:34.476477 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: Python main interpreter initialized at 0x5617313559c0 Apr 21 14:29:34.476477 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: dropping root privileges after plugin initialization Apr 21 14:29:34.476477 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: python threads support enabled Apr 21 14:29:34.476477 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: your server socket listen backlog is limited to 100 connections Apr 21 14:29:34.476477 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: your mercy for graceful operations on workers is 90 seconds Apr 21 14:29:34.477017 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: mapped 402621 bytes (393 KB) for 2 cores Apr 21 14:29:34.477017 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: *** Operational MODE: preforking *** Apr 21 14:29:34.477017 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: dropping root privileges after application loading Apr 21 14:29:34.477017 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: *** uWSGI is running in multiple interpreter mode *** Apr 21 14:29:34.478769 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: spawned uWSGI master process (pid: 85710) Apr 21 14:29:34.478769 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: spawned uWSGI worker 1 (pid: 85711, cores: 1) Apr 21 14:29:34.478769 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: spawned uWSGI worker 2 (pid: 85712, cores: 1) Apr 21 14:29:34.478769 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 21 14:29:34.477275 dv-cinder-786385-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 21 14:29:39.414505 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 21 14:29:39.415088 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 21 14:29:39.415188 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 21 14:29:39.415188 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 21 14:29:39.416322 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 21 14:29:39.416724 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 21 14:29:39.416873 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 21 14:29:39.417036 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 21 14:29:39.417117 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 21 14:29:39.417368 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 21 14:29:39.417501 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.417752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.417904 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.418160 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.418315 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.418512 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.418677 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.418843 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.418959 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.419211 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.419330 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.419523 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.419641 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.419865 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.420008 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.420205 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.420316 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.420486 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.420592 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.420820 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.420945 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.421161 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.421270 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786385-2-iscsi {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.421507 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.421637 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786385-2-iscsi {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.421830 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.421945 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.422212 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.422329 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.422541 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.422659 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.422868 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.422976 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.423206 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.423310 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.423530 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.423634 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.423859 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.424130 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.424452 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.424577 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.424765 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.424871 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.425092 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.425202 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.425425 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.425532 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.426117 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.426223 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.426453 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.426561 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.426786 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.426917 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.427120 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.427228 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.427451 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.427551 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.427784 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.427884 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.428114 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.428216 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786385-2-iscsi {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.428452 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.428551 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786385-2-iscsi {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.428831 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.428983 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.429181 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.429647 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.429998 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.430347 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.430705 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.431003 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.431110 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.431366 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.431476 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.431728 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.431850 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.432079 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.432438 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.432587 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.432779 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.432943 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.433108 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.433433 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.433544 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.433761 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.434132 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.434465 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.434738 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.434841 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.435122 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.435286 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.435472 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.435580 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.435827 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.435934 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.436178 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.436318 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.436535 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.436647 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.436830 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.436983 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.437090 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.437194 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.437409 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.437522 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.437764 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.437866 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.438123 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.438238 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.438459 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.438566 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.438789 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.438899 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.439121 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.439224 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.439455 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.439564 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.439785 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.439894 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.440117 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.440219 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.440398 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.440506 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.440677 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.440787 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.441033 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.441143 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.441390 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.441493 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.441727 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.441829 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.442084 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.442190 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.442423 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.442556 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.442730 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.442902 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.443068 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.443227 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.443369 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.443484 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.443713 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.443867 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.444052 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.444195 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.444420 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.444530 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.444796 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.444899 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.445125 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.445228 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.445461 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.445568 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.445795 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.445913 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.446172 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.446277 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.446509 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.446686 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.446838 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.446945 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.447113 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.447224 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.447439 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.447550 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.447772 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.447876 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.448121 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.448230 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.448453 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.448567 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.448781 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.448890 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.449108 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.449215 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.449432 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.449544 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.449756 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.449868 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.450108 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.450228 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.450445 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.450554 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.450720 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.450822 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.451046 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.451148 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.451377 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.451486 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.451700 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.451802 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.452028 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.452137 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.452349 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.452458 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.452676 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.452779 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.453001 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.453104 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.453326 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.453434 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.453649 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.453756 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.453976 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.454120 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.454321 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.454434 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.454649 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.454751 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.454973 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.455083 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.455298 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.455407 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.455629 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.455738 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.455955 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.456071 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.456285 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.456392 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.456623 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.456737 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.456947 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.457056 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.457270 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.457373 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.457599 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.457701 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.457917 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.458110 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.458274 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.458386 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.458596 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.458699 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.458924 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.459035 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.459247 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.459350 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.459576 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.459683 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.459899 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.460013 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.460246 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.460354 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.460577 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.460685 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.460898 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.461000 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.461216 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.461318 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.461540 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.461642 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.461869 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.461973 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.462239 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.462350 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.462561 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.462666 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.462886 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.462995 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.463202 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.463304 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.463529 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.463642 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.463854 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.463961 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.464180 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.464291 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.464507 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.464618 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.464832 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.464939 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.465158 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.465261 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.465505 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.465619 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.465857 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.465958 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.466209 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.466321 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.466541 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.466651 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.466867 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.466976 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.467199 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.467310 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:29:39.467535 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.467639 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.467871 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.467973 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.468222 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.468329 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.468554 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.468672 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.468907 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.469018 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.469247 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.469350 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.469582 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.469685 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.469914 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.470077 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.470289 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.470392 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.470629 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.470737 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.470958 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.471061 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.471296 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.471410 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.471625 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.471736 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.471966 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.472068 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.472310 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.472413 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.472658 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.472750 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.472993 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.473108 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.473322 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.473425 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.473659 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.473769 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.474015 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.474132 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.474345 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.474447 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.474680 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.474783 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.475024 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.475138 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.475352 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.475455 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.475698 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.475809 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.476090 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.476200 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.476435 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.476538 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.476777 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.476878 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.477110 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.477226 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.477440 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.477543 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.477768 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.477878 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.478126 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.478231 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.478450 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.478553 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.478787 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.478890 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.479141 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.479244 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.479470 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.479590 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.479829 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.479932 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.480161 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.480264 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.480497 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.480607 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.480831 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.480934 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.481161 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.481264 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.481493 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.481613 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.481822 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.481926 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.482182 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.482286 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.482528 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.482641 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.482858 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.482961 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.483187 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.483290 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.483536 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.483646 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.483861 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.483970 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.484185 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.484286 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.484514 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.484616 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.484843 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.484952 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.485178 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.485281 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.485507 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.485610 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.485838 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.485941 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.486198 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.486303 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.486530 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.486634 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.486862 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.486970 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.487213 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.487316 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.487538 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.487648 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.487861 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.487963 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.488200 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.488301 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.488537 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.488641 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.488862 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.488963 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.489189 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.489299 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.489512 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.489614 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.489842 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.489944 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.490197 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.490312 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.490529 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.490632 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.490859 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.490967 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.491189 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.491299 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.491544 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.491648 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.491873 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.491976 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.492201 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.492311 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.492535 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.492650 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.492864 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.493014 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.493189 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.493292 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.493510 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.493612 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.493837 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.493940 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.494239 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.494345 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.494565 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.494674 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.494901 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.495070 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.495234 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.495337 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.495564 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.495672 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.495895 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.496000 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.496228 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.496330 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.496560 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.496662 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.496884 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.496987 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.497214 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.497317 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.497542 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.497672 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.497865 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.497976 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.498227 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.498330 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.498557 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.498659 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.498892 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.499065 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.499236 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.499339 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.499583 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.499685 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.499910 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.500023 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.500236 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.500339 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.500567 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.500669 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.500897 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.501006 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.501232 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.501342 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.501673 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.501798 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.501904 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.502044 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.502215 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.502330 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.502543 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.502646 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.502875 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.502985 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.503211 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.503324 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.503541 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.503643 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.503865 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.503967 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.504209 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.504310 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.504538 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.504640 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.504862 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.504965 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.505191 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.505298 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.505515 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.505623 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.505845 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.505948 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.506204 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.506315 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.506538 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.506640 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.506872 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.507010 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.507244 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.507346 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.507570 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.507681 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.507911 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.508014 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.508238 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.508340 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.508560 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.508674 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.508881 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.508984 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.509210 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.509311 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.509560 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.509670 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.509889 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.510010 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.510244 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.510346 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.510585 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.510699 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.510913 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.511015 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.511242 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.511344 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.511579 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.511682 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.511907 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.512016 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.512234 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.512337 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.512556 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.512659 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.512891 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.512994 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.513218 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.513321 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.513554 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.513657 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.513877 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.513978 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.514243 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.514347 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.514576 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.514691 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.514912 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.515027 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.515236 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.515416 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.515564 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.515668 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.515890 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.515999 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.516219 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.516330 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.516553 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.516656 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.516888 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.516998 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.517219 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.517552 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.517655 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.517889 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.518042 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.518251 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.518355 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.518597 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.518700 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.518931 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.519040 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.519266 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.519369 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.519592 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.519695 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.519920 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.520023 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.520256 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.520370 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.520584 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.520686 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.520917 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.521246 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.521349 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.521575 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.521678 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.521943 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.522078 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.522258 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.522370 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.522601 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.522710 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.522932 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.523035 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.523266 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.523369 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.523593 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.523697 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.523921 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.524023 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.524248 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.524359 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.524577 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.524684 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.524907 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.524990 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.525228 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.525339 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.525558 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.525661 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.525879 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.526005 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.526229 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.526342 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.526561 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.526664 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.526886 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.526988 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.527207 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.527331 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.527529 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.527647 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.527849 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.527982 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.528181 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.528292 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.528521 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.528622 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.528849 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.528951 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.529186 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.529296 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.529515 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.529619 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.529840 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.529942 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.530202 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.530307 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.530530 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.530641 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.530855 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.530958 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.531178 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.531281 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.531503 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.531605 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.531830 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.531960 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.532168 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.532271 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.532514 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.532617 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.532848 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.532958 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.533174 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.533276 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.533499 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.533601 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.533820 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.533931 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.534184 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.534288 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.534508 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.534617 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.534836 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.534946 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.535160 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.535268 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.535487 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.535588 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.535814 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.535928 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.536135 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.536244 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.536520 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.536622 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.536859 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.536970 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.537192 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.537301 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.537525 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.537634 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.537854 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.537964 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.538248 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.538359 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.538580 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.538933 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.539275 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.539602 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.539934 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.540218 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.540321 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.540568 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.540708 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.540894 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.540996 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.541226 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.541553 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.541656 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.541879 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.542044 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.542247 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.542485 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.542587 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.542878 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.543230 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.543563 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.543724 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.543892 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.544097 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.544317 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.544481 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.544648 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.544833 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.545025 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.545184 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.545356 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.545611 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.545729 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.545902 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.547403 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.547579 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.547756 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.547927 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.547927 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.548272 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.548272 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.548272 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.548272 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.548684 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.548782 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.548878 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.548975 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.549202 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.549315 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.549551 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.549655 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.549878 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.549980 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.550239 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.550349 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.550908 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.551064 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.551251 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.551354 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.551586 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.551725 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.551941 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.552119 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.552280 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.552402 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.552581 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.552733 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.552892 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.553015 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.553226 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.553336 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.553564 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.553718 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.553925 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.554112 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.554294 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.554409 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.554637 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.554741 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.554975 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.555078 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.555313 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.555423 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.555650 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.555753 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.555988 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.556102 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.556324 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.556434 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.556658 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.556760 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.556987 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.557091 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.557325 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.557438 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.557656 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.557776 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.558012 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.558119 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.558342 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.558459 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.558667 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.558784 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.559004 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.559107 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.559338 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.559441 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.559675 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.559777 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.560005 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.560107 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.560353 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.560501 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.560690 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.560842 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.561030 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.561181 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.561368 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.561514 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.561709 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.561855 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.562102 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.562208 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.562446 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.562550 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.562786 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.562889 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.563133 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.563242 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.563477 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.563581 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.563816 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.563918 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.564157 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.564376 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.564488 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.564587 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.564807 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.564910 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.565140 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.565251 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.565467 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.565569 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.565821 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.565924 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.566178 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.566299 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.566502 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.566605 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.566831 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.566933 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.567163 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.567315 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.567492 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.567594 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.567816 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.567918 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.568278 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.568389 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.568619 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.568722 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.568943 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.569045 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.569269 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.569426 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.569670 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.569775 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.570024 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.570131 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.570382 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.570486 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.570726 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.570828 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.571065 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.571177 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.571454 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.571561 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.571797 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.571901 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.572136 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.572250 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.572476 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.572586 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.572821 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.572925 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.573153 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.573285 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.573489 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.573598 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.573818 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.573921 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.574191 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.574307 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.574524 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.574634 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.574857 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.574960 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.575200 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.575310 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.575527 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.575638 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.575882 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.575984 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.576305 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.576418 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.576657 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.576760 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.576982 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.577091 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.577317 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.577435 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.577655 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.577757 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.578048 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.578164 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.578362 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.578466 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.578697 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.578807 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.579055 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.579157 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.579387 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.579490 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.579727 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.579830 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.580063 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.580173 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.580398 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.580500 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.580732 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.580834 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.581061 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.581180 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.581401 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.581511 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.581726 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.581827 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.582102 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.582228 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.582447 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.582550 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.582791 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.582953 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.583121 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.583254 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.583451 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.583557 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.583806 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.583918 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.584139 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.584257 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.584485 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.584596 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.584815 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.584919 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.585170 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.585274 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.585549 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.585652 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.585880 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.585996 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.586238 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.586342 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.586572 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.586674 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.586927 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.587037 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.587261 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.587370 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.587590 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.587694 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.587927 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.588045 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.588262 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.588366 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.588591 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.588694 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.588919 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.589029 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.589244 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.589349 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.589574 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.589676 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.589903 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.590040 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.590264 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.590368 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.590595 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.590698 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.590923 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.591032 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.591252 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.591361 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.591583 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.591685 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.591909 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.592020 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.592232 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.592340 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.592555 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.592657 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.592886 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.592995 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.593230 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.593340 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.593565 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.593674 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.593895 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.594062 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.594221 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.594325 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.594554 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.594656 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.594918 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.595021 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.595240 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.595344 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.595605 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.595715 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.595942 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.596045 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.596287 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.596391 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.596635 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.596738 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.596963 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.597073 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.597286 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.597389 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.597621 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.597724 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.597952 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.598107 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.598309 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.598411 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.598639 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.598770 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.598970 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.599082 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.599291 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.599394 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.599618 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.599722 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.599945 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.600049 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.600280 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.600386 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.600604 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.600750 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.600994 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.601106 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.601345 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.601602 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.601705 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.601959 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.602107 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.602311 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.602413 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.602644 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.602747 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.602984 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.603088 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.603329 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.603432 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.603665 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.603767 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.604002 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.604112 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.604342 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.604446 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.604672 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.604780 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.605003 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.605108 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.605346 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.605450 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.605687 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.605789 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.606061 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.606168 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.606405 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.606509 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.606749 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.606915 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.607087 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.607190 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.607420 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.607523 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.607755 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.607865 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.608097 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.608200 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.608438 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.608541 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.608770 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.608918 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.609115 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.609372 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.609481 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.609729 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.609839 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.610113 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.610221 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.610454 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.610569 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.610786 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.610901 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.611125 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.611228 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.611456 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.611559 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.611784 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.611895 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.612111 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.612214 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.612445 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.612554 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.612776 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.612880 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.613132 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.613235 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.613470 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.613573 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.613811 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.613915 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.614175 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.614279 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.614546 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.614647 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.614865 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.615094 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.615201 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.615440 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.615589 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.615806 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.615909 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.616164 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.616288 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.616545 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.616648 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.616883 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.616986 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.617221 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.617325 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.617567 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.617684 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.617895 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.618050 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.618256 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.618359 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.618599 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.618714 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.618936 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.619038 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.619263 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.619364 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.619589 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.619700 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.619963 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.620076 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.620297 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.620504 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.620606 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.620712 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.620888 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.620992 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.621324 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.621481 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.621593 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.621872 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.622134 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.622291 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.622405 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.622576 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.622792 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.622933 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.623213 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.623337 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.623503 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.623607 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.623858 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.623970 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.624198 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.624301 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.624532 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.624635 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.624867 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.624980 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.625203 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.625314 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.625538 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.625653 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.625862 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.625965 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.626218 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.626334 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.626549 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.626660 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.626873 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.626975 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.627204 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.627306 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.627534 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.627644 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.627858 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.627967 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.628196 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.628299 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.628524 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.628640 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.628848 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.629115 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.629219 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.629489 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.629599 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.629820 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.629923 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.630176 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.630281 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.630514 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.630629 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.630852 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.630955 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.631175 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.631278 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.631509 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.631620 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.631834 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.631987 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.632212 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.632316 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.632542 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.632653 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.632873 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.632989 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.633196 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.633309 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.633547 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.633658 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.633878 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.634029 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.634248 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.634365 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.634564 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.634668 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.634899 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.635051 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.635227 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.635337 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.635565 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.635669 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.635902 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.636012 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.636231 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.636335 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.636563 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.636667 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.636900 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.637151 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.637278 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.637522 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.637633 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.637844 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.637955 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.638199 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.638303 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.638539 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.638651 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.638867 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.638970 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.639204 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.639326 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.639528 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.639634 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.639857 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.639960 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.640219 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.640331 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.640561 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.640666 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.640901 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.641004 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.641238 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.641341 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.641574 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.641706 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.641905 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.642028 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.642262 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.642366 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.642594 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.642699 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.642923 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.643028 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.643299 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.643425 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.643594 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.643699 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.643966 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.644081 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.644310 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.644420 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.644647 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.644910 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.645013 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.645278 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.645384 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.645615 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.645752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.645955 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.646141 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.646318 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.646423 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.646659 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.646764 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.646993 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.647102 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.647329 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.647517 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.647651 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.647752 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.648010 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.648116 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.648347 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.648477 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.648682 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.648786 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.649017 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.649128 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.649352 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.649465 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.649684 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.649788 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.650047 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.650156 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.650388 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.650501 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.650721 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.650826 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.651057 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.651163 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.651380 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.651491 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.651711 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.651816 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.652046 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.652150 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.652379 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.652490 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.652723 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.652827 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.653063 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.653167 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.653408 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.653525 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.653744 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.653850 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.654102 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.654222 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.654440 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.654551 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.654769 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.654890 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.655106 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.655251 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.655430 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.655535 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.655771 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.655876 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.656116 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.656228 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.656464 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.656568 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.656798 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.656901 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.657146 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.657259 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.657475 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.657580 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.657818 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.657923 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.658186 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.658307 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.658527 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.658638 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.658850 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.658954 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.659181 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.659286 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.659511 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.659615 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.659844 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.659946 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.660190 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.660297 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.660527 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.660631 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.660878 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.660993 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.661214 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.661319 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.661569 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.661676 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.661905 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.662060 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.662268 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.662380 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.662601 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.662711 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.662952 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.663063 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.663335 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.663447 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.663675 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.663780 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.664015 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.664126 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.664353 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.664457 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.664731 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.664849 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.665013 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.665126 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.665344 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.665448 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.665690 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.665794 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.666035 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.666155 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.666371 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.666481 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.666705 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.666809 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.667045 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.667149 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.667390 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.667494 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.667723 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.667827 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.668075 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.668178 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.668404 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.668508 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.668745 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.668849 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.669072 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.669176 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.669401 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.669552 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.669744 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.669857 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.670121 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.670229 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.670457 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.670561 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.670806 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.670925 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.671135 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.671245 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.671470 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.671573 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.671804 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.671918 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.672139 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.672243 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.672474 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.672578 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.672814 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.672928 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.673084 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85711) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 21 14:29:39.673200 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.673499 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.673833 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.674233 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.674580 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.674925 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.675267 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.675911 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.676273 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.676622 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.676960 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.677301 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.677634 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.677974 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.678335 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.678687 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.679076 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.679430 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.679792 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.680168 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.680505 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.680881 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.681243 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:29:39.681510 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 21 14:29:39.709949 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_db.sqlalchemy.engines [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85711) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:29:39.717715 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_db.sqlalchemy.engines [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85712) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:29:40.051875 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.context [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee5823f9-95bd-47be-a7d6-f14717896ffb(cell1) {{(pid=85711) load_cells /opt/stack/nova/nova/context.py:466}} Apr 21 14:29:40.057515 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85711) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:29:40.057908 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.context [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee5823f9-95bd-47be-a7d6-f14717896ffb(cell1) {{(pid=85712) load_cells /opt/stack/nova/nova/context.py:466}} Apr 21 14:29:40.059467 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85711) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:29:40.060345 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85711) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:29:40.062563 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85711) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:29:40.063442 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:29:40.065313 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:29:40.066231 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:29:40.068330 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:29:40.086632 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_db.sqlalchemy.engines [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85711) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:29:40.091144 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_db.sqlalchemy.engines [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85711) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:29:40.097266 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_db.sqlalchemy.engines [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85712) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:29:40.098156 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_db.sqlalchemy.engines [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85712) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:29:40.121824 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_db.sqlalchemy.engines [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85711) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:29:40.129146 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_db.sqlalchemy.engines [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85712) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:29:40.222500 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 21 14:29:40.222500 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: from cryptography.utils import int_from_bytes Apr 21 14:29:40.222836 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 21 14:29:40.222836 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: from cryptography.utils import int_from_bytes Apr 21 14:29:40.222963 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 21 14:29:40.222963 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: from cryptography.utils import int_from_bytes Apr 21 14:29:40.223114 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 21 14:29:40.223114 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: from cryptography.utils import int_from_bytes Apr 21 14:29:40.300018 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Loading Gnome Apr 21 14:29:40.300230 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Loading Gnome Apr 21 14:29:40.321646 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Loading Google Apr 21 14:29:40.321842 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Loading Google Apr 21 14:29:40.325251 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Loading Windows (alt) Apr 21 14:29:40.325416 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Loading Windows (alt) Apr 21 14:29:40.329890 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Loading file Apr 21 14:29:40.330711 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Loading file Apr 21 14:29:40.331014 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Loading keyczar Apr 21 14:29:40.331460 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Loading multi Apr 21 14:29:40.332056 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Loading keyczar Apr 21 14:29:40.332323 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Loading pyfs Apr 21 14:29:40.332592 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Loading multi Apr 21 14:29:40.333685 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO keyring.backend [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Loading pyfs Apr 21 14:29:40.609756 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WARNING keystonemiddleware.auth_token [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 14:29:40.612391 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WARNING keystonemiddleware.auth_token [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 14:29:40.616928 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WARNING keystonemiddleware.auth_token [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 14:29:40.619663 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WARNING keystonemiddleware.auth_token [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 14:29:40.951612 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WARNING keystonemiddleware.auth_token [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 14:29:40.954220 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WARNING keystonemiddleware.auth_token [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 14:29:40.957333 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WARNING keystonemiddleware.auth_token [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 14:29:40.959943 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WARNING keystonemiddleware.auth_token [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 14:29:40.963779 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5617313559c0 pid: 85712 (default app) Apr 21 14:29:40.966035 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:29:40.966476 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5617313559c0 pid: 85711 (default app) Apr 21 14:29:40.967243 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-16f41ed1-8bab-417e-8bf9-c82b15c30bf5 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001817 Apr 21 14:29:40.967638 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 779 bytes} [Wed Apr 21 14:29:40 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:07.609183 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:07.610387 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002092 Apr 21 14:31:07.611017 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:07 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:08.121285 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-60bf995f-2ff9-45b7-aa04-54c1254c7f9b admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:08.152619 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-60bf995f-2ff9-45b7-aa04-54c1254c7f9b admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.533858 Apr 21 14:31:08.158336 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 2/3] 10.222.0.24 () {60 vars in 1281 bytes} [Wed Apr 21 14:31:07 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:10.711681 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:10.712925 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-8ececcdb-e30f-4e10-ac85-a7d6bb6b34d0 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001782 Apr 21 14:31:10.713329 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 2/4] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:10.780939 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-abe5c314-da7b-4338-8c9d-8bf7d233ea87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 256}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:10.810320 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:31:10.810320 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: warnings.warn(msg) Apr 21 14:31:10.839917 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-abe5c314-da7b-4338-8c9d-8bf7d233ea87 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.119118 Apr 21 14:31:10.840597 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 3/5] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:10 2021] POST /compute/v2.1/flavors => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:31:11.176346 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-f2b8bf09-744c-40fb-84bd-af5dbf52b6ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:11.181364 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:31:11.181364 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: warnings.warn(msg) Apr 21 14:31:11.239941 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-f2b8bf09-744c-40fb-84bd-af5dbf52b6ee admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.390198 Apr 21 14:31:11.240875 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 3/6] 10.222.0.24 () {64 vars in 1325 bytes} [Wed Apr 21 14:31:10 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:13.843654 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-abe5c314-da7b-4338-8c9d-8bf7d233ea87 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:13.844733 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-abe5c314-da7b-4338-8c9d-8bf7d233ea87 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Apr 21 14:31:13.845165 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 4/7] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:13.972792 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-6ca4fda0-f044-4d48-98a8-998ed6725fb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "disk": 5, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:13.998591 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:31:13.998591 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: warnings.warn(msg) Apr 21 14:31:14.030441 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-6ca4fda0-f044-4d48-98a8-998ed6725fb4 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.178263 Apr 21 14:31:14.038370 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 4/8] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:31:14.044346 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-d7786d54-3958-48be-bf5e-faf5648ae09c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:14.046337 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:31:14.046337 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: warnings.warn(msg) Apr 21 14:31:14.086969 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-d7786d54-3958-48be-bf5e-faf5648ae09c admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046428 Apr 21 14:31:14.095817 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 5/9] 10.222.0.24 () {64 vars in 1325 bytes} [Wed Apr 21 14:31:14 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:16.668125 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-6ca4fda0-f044-4d48-98a8-998ed6725fb4 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:16.669385 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-6ca4fda0-f044-4d48-98a8-998ed6725fb4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Apr 21 14:31:16.669948 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:16.739614 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-4c4e5654-d74e-4f8d-b19f-af8d0e4c5f9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:16.765927 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-4c4e5654-d74e-4f8d-b19f-af8d0e4c5f9f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087752 Apr 21 14:31:16.767365 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 6/11] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:31:16.780014 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-79cd2808-bec1-488f-82b7-fde39a140585 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:16.824372 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-79cd2808-bec1-488f-82b7-fde39a140585 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048736 Apr 21 14:31:16.825116 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 6/12] 10.222.0.24 () {64 vars in 1325 bytes} [Wed Apr 21 14:31:16 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:19.367015 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-4c4e5654-d74e-4f8d-b19f-af8d0e4c5f9f admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:19.368083 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-4c4e5654-d74e-4f8d-b19f-af8d0e4c5f9f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Apr 21 14:31:19.368503 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 7/13] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:19.431130 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-c791c621-068a-43d8-8b62-8bb9d8b961a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "ram": 2048, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:19.456242 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-c791c621-068a-43d8-8b62-8bb9d8b961a6 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081116 Apr 21 14:31:19.456815 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 7/14] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:31:19.469923 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-1a81de83-b216-4f19-ad11-b166b187d2ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:19.507289 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-1a81de83-b216-4f19-ad11-b166b187d2ea admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041490 Apr 21 14:31:19.507866 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 8/15] 10.222.0.24 () {64 vars in 1325 bytes} [Wed Apr 21 14:31:19 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:22.025890 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-c791c621-068a-43d8-8b62-8bb9d8b961a6 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:22.027078 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-c791c621-068a-43d8-8b62-8bb9d8b961a6 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Apr 21 14:31:22.027732 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 8/16] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:22.093694 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-384f7772-2277-4044-95e0-0c44f2662c24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "id": "d4"}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:22.119786 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-384f7772-2277-4044-95e0-0c44f2662c24 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085461 Apr 21 14:31:22.120681 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 9/17] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:31:22.134532 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-02bb087b-1448-4220-94f1-ac5c621bbcc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:22.173631 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-02bb087b-1448-4220-94f1-ac5c621bbcc0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043647 Apr 21 14:31:22.174575 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 9/18] 10.222.0.24 () {64 vars in 1325 bytes} [Wed Apr 21 14:31:22 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:24.704675 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-384f7772-2277-4044-95e0-0c44f2662c24 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:24.706117 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-384f7772-2277-4044-95e0-0c44f2662c24 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Apr 21 14:31:24.706694 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 10/19] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:24 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:24.783750 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-850d045a-8934-4723-91e1-1abf1d8b291e admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:24.810869 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-850d045a-8934-4723-91e1-1abf1d8b291e admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.097217 Apr 21 14:31:24.811465 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 10/20] 10.222.0.24 () {60 vars in 1281 bytes} [Wed Apr 21 14:31:24 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:31:27.434099 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-384f7772-2277-4044-95e0-0c44f2662c24 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:27.435733 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-384f7772-2277-4044-95e0-0c44f2662c24 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002403 Apr 21 14:31:27.436389 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 11/21] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:27 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:27.507367 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-1a01b24b-0bcc-439c-910a-779bc6b16960 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:27.538993 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-1a01b24b-0bcc-439c-910a-779bc6b16960 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.093406 Apr 21 14:31:27.539681 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 11/22] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:27 2021] POST /compute/v2.1/flavors => generated 402 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:31:27.555497 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-720b57ee-3640-46b4-aab5-f1fb80f54a36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:27.596344 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-720b57ee-3640-46b4-aab5-f1fb80f54a36 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045840 Apr 21 14:31:27.597074 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 12/23] 10.222.0.24 () {64 vars in 1322 bytes} [Wed Apr 21 14:31:27 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:30.443944 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-1a01b24b-0bcc-439c-910a-779bc6b16960 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:30.445090 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-1a01b24b-0bcc-439c-910a-779bc6b16960 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 Apr 21 14:31:30.445557 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 12/24] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:30.509653 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-1828c5a2-962d-40e7-9679-944ecaf6c382 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:30.535612 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-1828c5a2-962d-40e7-9679-944ecaf6c382 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082738 Apr 21 14:31:30.536221 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 13/25] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:30 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:31:30.549562 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-d1de7488-c997-4e0d-ad12-9c812070a61d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:30.589254 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-d1de7488-c997-4e0d-ad12-9c812070a61d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043810 Apr 21 14:31:30.589869 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 13/26] 10.222.0.24 () {64 vars in 1322 bytes} [Wed Apr 21 14:31:30 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:33.071167 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-1828c5a2-962d-40e7-9679-944ecaf6c382 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:33.072247 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-1828c5a2-962d-40e7-9679-944ecaf6c382 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Apr 21 14:31:33.072923 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 14/27] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:33.138135 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-b00be566-65d9-439d-803c-4851422b587a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:33.165256 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-b00be566-65d9-439d-803c-4851422b587a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085405 Apr 21 14:31:33.165961 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 14/28] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:33 2021] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:31:33.187352 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-3b5e8ce3-4529-4057-8678-2c848638d12e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:33.231170 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-3b5e8ce3-4529-4057-8678-2c848638d12e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047718 Apr 21 14:31:33.232182 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 15/29] 10.222.0.24 () {64 vars in 1322 bytes} [Wed Apr 21 14:31:33 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:35.851823 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-b00be566-65d9-439d-803c-4851422b587a admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:35.852903 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-b00be566-65d9-439d-803c-4851422b587a admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Apr 21 14:31:35.853343 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 15/30] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:35.922715 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-c46d1961-c7e6-49d6-86b5-79bf650afa93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:35.951758 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-c46d1961-c7e6-49d6-86b5-79bf650afa93 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.091704 Apr 21 14:31:35.952334 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 16/31] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:31:35.965812 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-09e2b891-31d1-4ada-a6f5-6c922c5dd7a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:36.041474 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-09e2b891-31d1-4ada-a6f5-6c922c5dd7a6 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075738 Apr 21 14:31:36.061402 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 16/32] 10.222.0.24 () {64 vars in 1322 bytes} [Wed Apr 21 14:31:35 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:31:38.572642 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-c46d1961-c7e6-49d6-86b5-79bf650afa93 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:31:38.573771 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-c46d1961-c7e6-49d6-86b5-79bf650afa93 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Apr 21 14:31:38.574403 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 17/33] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:31:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:31:38.642167 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-75f1a16b-d76e-4270-94e6-ca43f65b8082 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "id": "5", "swap": 0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:38.667917 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-75f1a16b-d76e-4270-94e6-ca43f65b8082 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.086980 Apr 21 14:31:38.668751 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 17/34] 10.222.0.24 () {64 vars in 1272 bytes} [Wed Apr 21 14:31:38 2021] POST /compute/v2.1/flavors => generated 408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:31:38.682191 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-f7deba45-197f-407d-ad87-7a7e2211a8a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:31:38.724038 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-f7deba45-197f-407d-ad87-7a7e2211a8a0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045764 Apr 21 14:31:38.731236 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 18/35] 10.222.0.24 () {64 vars in 1322 bytes} [Wed Apr 21 14:31:38 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:32:18.647647 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-75f1a16b-d76e-4270-94e6-ca43f65b8082 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:18.648706 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-75f1a16b-d76e-4270-94e6-ca43f65b8082 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Apr 21 14:32:18.649169 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 18/36] 10.222.0.24 () {54 vars in 920 bytes} [Wed Apr 21 14:32:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:32:18.717749 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-5da3169d-ad2e-4d05-b6d4-49e97fea8e44 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:18.746703 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-5da3169d-ad2e-4d05-b6d4-49e97fea8e44 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.090463 Apr 21 14:32:18.747291 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 19/37] 10.222.0.24 () {60 vars in 1281 bytes} [Wed Apr 21 14:32:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:32:20.430026 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-75f1a16b-d76e-4270-94e6-ca43f65b8082 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:20.431114 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-75f1a16b-d76e-4270-94e6-ca43f65b8082 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Apr 21 14:32:20.431552 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 19/38] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:32:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:32:20.613389 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-f79cbf03-9712-46e0-9514-b9fe8d858704 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:20.628095 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.wsgi [None req-f79cbf03-9712-46e0-9514-b9fe8d858704 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 21 14:32:20.628804 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-f79cbf03-9712-46e0-9514-b9fe8d858704 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:32:20.629676 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-f79cbf03-9712-46e0-9514-b9fe8d858704 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.072495 Apr 21 14:32:20.630278 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 20/39] 10.222.0.24 () {60 vars in 1181 bytes} [Wed Apr 21 14:32:20 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 21 14:32:20.640967 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-ace1d2d7-86d9-4a31-be6e-1ada6096d0af admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:20.663617 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-ace1d2d7-86d9-4a31-be6e-1ada6096d0af admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026716 Apr 21 14:32:20.664228 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 20/40] 10.222.0.24 () {60 vars in 1201 bytes} [Wed Apr 21 14:32:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:32:20.675359 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-ae796f29-74dd-446a-957b-d2f758a29585 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:20.699306 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-ae796f29-74dd-446a-957b-d2f758a29585 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027770 Apr 21 14:32:20.699922 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 21/41] 10.222.0.24 () {60 vars in 1201 bytes} [Wed Apr 21 14:32:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:32:20.710975 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-eedbf108-a8fa-49f0-a473-285848a8de5c admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:20.725552 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.wsgi [None req-eedbf108-a8fa-49f0-a473-285848a8de5c admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 21 14:32:20.726215 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-eedbf108-a8fa-49f0-a473-285848a8de5c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:32:20.727080 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-eedbf108-a8fa-49f0-a473-285848a8de5c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.020100 Apr 21 14:32:20.727695 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 21/42] 10.222.0.24 () {60 vars in 1181 bytes} [Wed Apr 21 14:32:20 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 21 14:32:22.278670 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-ae796f29-74dd-446a-957b-d2f758a29585 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:22.279698 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-ae796f29-74dd-446a-957b-d2f758a29585 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Apr 21 14:32:22.280126 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 22/43] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:32:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:32:22.464362 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-0af03cab-8896-4b18-8211-1de1c7f5b2f3 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:22.477730 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.wsgi [None req-0af03cab-8896-4b18-8211-1de1c7f5b2f3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 21 14:32:22.478351 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-0af03cab-8896-4b18-8211-1de1c7f5b2f3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:32:22.479209 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-0af03cab-8896-4b18-8211-1de1c7f5b2f3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.072423 Apr 21 14:32:22.479780 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 22/44] 10.222.0.24 () {60 vars in 1181 bytes} [Wed Apr 21 14:32:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 21 14:32:22.490525 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-895310b5-730b-40a6-b27b-90c2eff8573b admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:22.512610 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-895310b5-730b-40a6-b27b-90c2eff8573b admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026139 Apr 21 14:32:22.513200 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 23/45] 10.222.0.24 () {60 vars in 1201 bytes} [Wed Apr 21 14:32:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:32:22.524458 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-ab76b88a-2310-499a-ad87-731ad9e65e93 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:22.546541 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-ab76b88a-2310-499a-ad87-731ad9e65e93 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026200 Apr 21 14:32:22.547063 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 23/46] 10.222.0.24 () {60 vars in 1201 bytes} [Wed Apr 21 14:32:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:32:22.558107 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-7c167e5e-ab16-4f91-ad9b-6fedc18c0efc admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:22.571542 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.wsgi [None req-7c167e5e-ab16-4f91-ad9b-6fedc18c0efc admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 21 14:32:22.572163 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-7c167e5e-ab16-4f91-ad9b-6fedc18c0efc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:32:22.573020 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-7c167e5e-ab16-4f91-ad9b-6fedc18c0efc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018929 Apr 21 14:32:22.573580 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 24/47] 10.222.0.24 () {60 vars in 1181 bytes} [Wed Apr 21 14:32:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 21 14:32:24.162717 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-ab76b88a-2310-499a-ad87-731ad9e65e93 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:24.163794 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-ab76b88a-2310-499a-ad87-731ad9e65e93 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Apr 21 14:32:24.164310 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 24/48] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:32:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:32:24.348779 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-c0ef258f-b6c5-4245-91cd-7bcd5f516437 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:24.362055 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.wsgi [None req-c0ef258f-b6c5-4245-91cd-7bcd5f516437 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 21 14:32:24.362657 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-c0ef258f-b6c5-4245-91cd-7bcd5f516437 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:32:24.363527 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-c0ef258f-b6c5-4245-91cd-7bcd5f516437 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.072020 Apr 21 14:32:24.364072 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 25/49] 10.222.0.24 () {60 vars in 1184 bytes} [Wed Apr 21 14:32:24 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 21 14:32:24.374431 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-eae8760c-60da-47b2-9ff5-156d8aae3613 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:24.396232 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-eae8760c-60da-47b2-9ff5-156d8aae3613 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025615 Apr 21 14:32:24.396808 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 25/50] 10.222.0.24 () {60 vars in 1201 bytes} [Wed Apr 21 14:32:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:32:24.407513 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:24.429855 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026183 Apr 21 14:32:24.430446 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 26/51] 10.222.0.24 () {60 vars in 1201 bytes} [Wed Apr 21 14:32:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:32:24.441454 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-765edca2-93e2-4efa-a676-2f7389a7a848 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:24.454845 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.wsgi [None req-765edca2-93e2-4efa-a676-2f7389a7a848 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 21 14:32:24.455468 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-765edca2-93e2-4efa-a676-2f7389a7a848 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:32:24.456312 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-765edca2-93e2-4efa-a676-2f7389a7a848 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018977 Apr 21 14:32:24.456982 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 26/52] 10.222.0.24 () {60 vars in 1184 bytes} [Wed Apr 21 14:32:24 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 21 14:32:26.030996 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:26.032079 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Apr 21 14:32:26.032513 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 27/53] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:32:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:32:26.218399 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-355e13b9-f57a-4fd8-8b1a-462f17b82fc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:32:26.243687 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-355e13b9-f57a-4fd8-8b1a-462f17b82fc5 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.083036 Apr 21 14:32:26.244205 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 27/54] 10.222.0.24 () {64 vars in 1226 bytes} [Wed Apr 21 14:32:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:32:27.813639 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:27.814959 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Apr 21 14:32:27.815494 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 28/55] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:32:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:32:28.005568 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-7eb661f6-56d5-4c68-a6dc-99dc722d5b1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:32:28.033611 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-7eb661f6-56d5-4c68-a6dc-99dc722d5b1c admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.090287 Apr 21 14:32:28.034346 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 28/56] 10.222.0.24 () {64 vars in 1226 bytes} [Wed Apr 21 14:32:27 2021] POST /compute/v2.1/flavors => generated 405 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:32:29.661562 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:29.662702 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Apr 21 14:32:29.663120 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 29/57] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:32:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:32:29.853383 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-297bd4f9-7929-409c-bf99-7d810e32920f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:32:29.882493 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-297bd4f9-7929-409c-bf99-7d810e32920f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.089764 Apr 21 14:32:29.883183 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 29/58] 10.222.0.24 () {64 vars in 1226 bytes} [Wed Apr 21 14:32:29 2021] POST /compute/v2.1/flavors => generated 407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:32:31.539092 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:31.540187 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Apr 21 14:32:31.540627 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 30/59] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:32:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:32:31.760331 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-d0c6a31a-d679-4145-8144-58f943ab44c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:32:31.785536 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-d0c6a31a-d679-4145-8144-58f943ab44c0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.097823 Apr 21 14:32:31.786186 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 30/60] 10.222.0.24 () {64 vars in 1226 bytes} [Wed Apr 21 14:32:31 2021] POST /compute/v2.1/flavors => generated 409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:32:33.512594 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:33.513657 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Apr 21 14:32:33.514118 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 31/61] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:32:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:32:33.728755 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-71460c1c-9257-4d3d-85fa-b183e1a3705a admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:32:33.757975 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-71460c1c-9257-4d3d-85fa-b183e1a3705a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.090968 Apr 21 14:32:33.758641 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 31/62] 10.222.0.24 () {60 vars in 1193 bytes} [Wed Apr 21 14:32:33 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:33:28.641188 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:33:28.642375 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-6b6f299e-f4d0-4200-9bd7-5337e1bdb508 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Apr 21 14:33:28.642965 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 32/63] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:33:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:33:28.835701 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-fd0bea7f-529d-4090-a64b-0bc490b89f49 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:33:28.866518 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-fd0bea7f-529d-4090-a64b-0bc490b89f49 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.091778 Apr 21 14:33:28.867029 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 32/64] 10.222.0.24 () {60 vars in 1193 bytes} [Wed Apr 21 14:33:28 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:34:59.638092 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-5fc60951-bd3c-4ce7-819b-f0e6406d1160 tempest-verify_tempest_config-746927192 tempest-verify_tempest_config-746927192-project] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:34:59.640550 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-5fc60951-bd3c-4ce7-819b-f0e6406d1160 tempest-verify_tempest_config-746927192 tempest-verify_tempest_config-746927192-project] 10.222.0.24 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.137483 Apr 21 14:34:59.641444 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 33/65] 10.222.0.24 () {58 vars in 1124 bytes} [Wed Apr 21 14:34:59 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:36:36.631565 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-fd0bea7f-529d-4090-a64b-0bc490b89f49 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:36:36.632678 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-fd0bea7f-529d-4090-a64b-0bc490b89f49 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Apr 21 14:36:36.633110 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 33/66] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:36:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:36:36.912184 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-ea622b12-bdc0-43bd-bfa3-c1c55a7eb739 admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:36:36.913678 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:36:36.913678 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: warnings.warn(msg) Apr 21 14:36:36.915820 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-ea622b12-bdc0-43bd-bfa3-c1c55a7eb739 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:36:36.916373 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-ea622b12-bdc0-43bd-bfa3-c1c55a7eb739 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:36:36.917284 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-ea622b12-bdc0-43bd-bfa3-c1c55a7eb739 admin admin] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:36:36.917806 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-ea622b12-bdc0-43bd-bfa3-c1c55a7eb739 admin admin] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:36:36.962147 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-ea622b12-bdc0-43bd-bfa3-c1c55a7eb739 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.198181 Apr 21 14:36:36.963174 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 34/67] 10.222.0.24 () {60 vars in 1184 bytes} [Wed Apr 21 14:36:36 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:36:38.634729 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-fd0bea7f-529d-4090-a64b-0bc490b89f49 admin admin] Calling method '>' {{(pid=85711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:36:38.636312 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-fd0bea7f-529d-4090-a64b-0bc490b89f49 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002068 Apr 21 14:36:38.636948 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85711|app: 0|req: 34/68] 10.222.0.24 () {56 vars in 1065 bytes} [Wed Apr 21 14:36:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:36:38.834987 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG nova.api.openstack.wsgi [None req-ab73c74f-7a58-4beb-b233-4e4a3ee8cd2f admin admin] Calling method '>' {{(pid=85712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:36:38.836359 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:36:38.836359 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: warnings.warn(msg) Apr 21 14:36:38.838116 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-ab73c74f-7a58-4beb-b233-4e4a3ee8cd2f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:36:38.838620 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-ab73c74f-7a58-4beb-b233-4e4a3ee8cd2f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:36:38.839472 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-ab73c74f-7a58-4beb-b233-4e4a3ee8cd2f admin admin] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:36:38.839941 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: DEBUG oslo_concurrency.lockutils [None req-ab73c74f-7a58-4beb-b233-4e4a3ee8cd2f admin admin] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:36:38.872216 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: INFO nova.api.openstack.requestlog [None req-ab73c74f-7a58-4beb-b233-4e4a3ee8cd2f admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.100046 Apr 21 14:36:38.873001 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: [pid: 85712|app: 0|req: 35/69] 10.222.0.24 () {60 vars in 1184 bytes} [Wed Apr 21 14:36:38 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:37:37.822861 dv-cinder-786385-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 21 14:37:37.823425 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: Wed Apr 21 14:37:37 2021 - graceful shutdown triggered... Apr 21 14:37:37.823880 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: Gracefully killing worker 1 (pid: 85711)... Apr 21 14:37:37.824231 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: Gracefully killing worker 2 (pid: 85712)... Apr 21 14:37:38.824580 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: worker 1 buried after 1 seconds Apr 21 14:37:38.824580 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: worker 2 buried after 1 seconds Apr 21 14:37:38.824580 dv-cinder-786385-2-iscsi devstack@n-api.service[85710]: goodbye to uWSGI. Apr 21 14:37:38.826663 dv-cinder-786385-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 21 14:37:38.828511 dv-cinder-786385-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 21 14:37:38.837436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Apr 21 14:37:38 2021] *** Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: nodename: dv-cinder-786385-2-iscsi Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: machine: x86_64 Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: clock source: unix Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: pcre jit disabled Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: detected number of CPU cores: 4 Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: current working directory: / Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: detected binary path: /usr/bin/uwsgi-core Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: dropping root privileges as early as possible Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: your processes number limit is 47843 Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: your memory page size is 4096 bytes Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: detected max file descriptor number: 2048 Apr 21 14:37:38.839513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: lock engine: pthread robust mutexes Apr 21 14:37:38.841255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: thunder lock: enabled Apr 21 14:37:38.841255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 21 14:37:38.841255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: dropping root privileges after socket binding Apr 21 14:37:38.841255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 21 14:37:38.887069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Python main interpreter initialized at 0x56151342a9c0 Apr 21 14:37:38.887069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: dropping root privileges after plugin initialization Apr 21 14:37:38.887069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: python threads support enabled Apr 21 14:37:38.887069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: your server socket listen backlog is limited to 100 connections Apr 21 14:37:38.887069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: your mercy for graceful operations on workers is 90 seconds Apr 21 14:37:38.888067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: mapped 402621 bytes (393 KB) for 2 cores Apr 21 14:37:38.888067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: *** Operational MODE: preforking *** Apr 21 14:37:38.888067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: dropping root privileges after application loading Apr 21 14:37:38.888067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: *** uWSGI is running in multiple interpreter mode *** Apr 21 14:37:38.888067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: spawned uWSGI master process (pid: 100561) Apr 21 14:37:38.888052 dv-cinder-786385-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 21 14:37:38.889318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: spawned uWSGI worker 1 (pid: 100563, cores: 1) Apr 21 14:37:38.889318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: spawned uWSGI worker 2 (pid: 100564, cores: 1) Apr 21 14:37:38.889318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 21 14:37:44.398066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 21 14:37:44.398723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 21 14:37:44.399992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 21 14:37:44.400448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 21 14:37:44.400739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 21 14:37:44.401197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.401649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.402148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.402578 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.403152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.403541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.403937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.404354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.404906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.405347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.405781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.406262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786385-2-iscsi {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.406669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.407067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.407466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.407845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.408201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.408579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.408933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.409570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.409923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.410714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.410714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.411043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.411389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.411743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.412115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.412670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.413067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.413420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.413786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786385-2-iscsi {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.414200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.414616 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.415245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.416020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.416404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.416794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.417217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.417615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.418071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.418476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.418851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.419222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.419604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.419955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.420310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.420666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.421039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.421389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.421740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.422055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.422420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.422790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.423161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.423540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.423827 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.424117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.424487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.424856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.425216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.425568 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.426272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.426624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.426973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.427327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.427678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.428034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.428411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.428772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.429142 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.429490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.429856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.430398 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.430693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.431045 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.431442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.431809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.432158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.432524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.432915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.433249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.433710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.434091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.434474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.434847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.435197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.435486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.435830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.436180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.436545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.436896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.437247 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.437599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.437943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.438335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.438682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.439029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.439368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.439729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.440075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.440416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.440782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.441113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.441489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.441858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.442300 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.442660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.442882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.443228 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.443584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.443936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.444286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.444655 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.445005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.445347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.445710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.446083 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.446422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.446791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.447133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.447493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.447857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.448204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.448540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.448883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.449318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.449712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.450250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.450650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.450992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.451334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.451710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.452085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.452448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.452787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.453132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.453505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:44.453887 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.454303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.454697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.455056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.455440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.455827 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.456180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.456538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.456892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.457272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.457632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.458018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.458367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.458735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.459096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.459468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.459832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.460192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.460544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.460902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.461252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.461621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.462009 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.462367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.462759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.463159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.463509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.463883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.464232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.464652 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.464995 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.465354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.465712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.466095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.466454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.466800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.467195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.467560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.467921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.468270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.468621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.468971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.469323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.469661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.470078 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.470459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.470813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.471213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.471554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.471907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.472266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.472615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.472973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.473327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.473670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.474058 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.474416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.474761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.475208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.475579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.476050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.476511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.476885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.477250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.477605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.478053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.478464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.479025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.479490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.479865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.480323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.480643 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.481025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.481390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.481730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.482131 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.482486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.482833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.483177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.483529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.483876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.484232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.484583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.484932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.485281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.485653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.486014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.486378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.486729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.487075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.487488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.487841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.488226 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.488586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.488957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.489317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.489672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.490053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.490409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.490767 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.491142 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.491490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.491847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.492199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.492553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.492925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.493309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.493653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.494027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.494418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.494773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.495127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.495489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.495884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.496203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.496558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.496921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.497288 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.497637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.498021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.498378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.498741 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.499090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.499432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.499799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.500176 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.500526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.500892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.501266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.501617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.501955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.502359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.502713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.503060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.503654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.504001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.504418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.504805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.505157 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.505509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.505875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.506272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.506629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.506983 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.507339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.507722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.508073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.508423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.508780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.509145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.509486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.509847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.510284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.510642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.510986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.511340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.511750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.512104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.512467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.513183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.513554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.513923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.514315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.514676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.515042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.515427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.515805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.516169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.516521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.516867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.517222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.517651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.518039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.518494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.518848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.519206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.519559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.519906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.520266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.520615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.520964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.521326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.521674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.522067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.522414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.522801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.523167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.523515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.523865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.524211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.524606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.524956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.525354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.525732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.526181 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.526532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.526887 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.527294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.527723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.527970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.528320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.528679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.529027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.529388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.529745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.530126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.530485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.530836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.531184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.531543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.531882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.532226 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.532570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.532933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.533286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.533632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.534069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.534395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.534746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.535101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.535439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.535783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.536136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.536523 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.536885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.537230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.537600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.537942 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.538327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.538671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.539030 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.539376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.539727 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.540065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.540409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.540765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.541134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.541495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.542037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.542373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.542842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.543213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.543565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.544001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.544355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.544714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.545091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.545443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.545795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.546189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.546543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.546923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.547253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.547619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.547995 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.548390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.548790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.549154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.549511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.549879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.550347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.551022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.551594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.552094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.552460 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.552844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.553202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.553560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.553918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.554290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.554650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.555004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.555365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.555726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.556094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.556449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.556796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.557189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.557542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.557888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.558271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.558627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.558982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.559358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.559835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.560219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.560546 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.560921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.561250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.561601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.561959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.562349 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.562699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.563219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.563547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.563904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.564256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.564606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.564975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.565329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.565677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.566059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.566437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.566782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.567154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.567509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.567877 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.568377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.568731 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.569080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.569561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.569896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.570290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.570656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.571037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.571411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.571749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.572122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.572464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.572839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.573210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.573569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.573930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.574344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.574728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.575099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.575458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.575824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.576327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.576700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.577061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.577447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.577825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.578213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.578563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.578918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.579268 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.579608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.579987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.580353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.580696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.581046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.581397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.581745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.582121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.582497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.582847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.583218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.583579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.583951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.584304 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.584650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.585020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.585441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.585800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.586353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.586890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.587319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.587673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.588046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.588495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.588983 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.589356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.589772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.590190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.590550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.590917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.591297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.591647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.591997 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.592357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.592707 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.593056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.593407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.593763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.594134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.594487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.594834 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.595212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.595561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.595935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.596281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.596631 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.596985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.597337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.597736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.598136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.598535 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.598905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.599267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.599653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.600015 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.600394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.600756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.601115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.601475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.601835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.602222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.602585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.602943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.603290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.603650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.604016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.604377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.605045 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.605477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.605837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.606224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.606572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.606937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.607297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.607654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.608006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.608369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.608719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.609097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.609479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.609861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.610278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.610648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.611005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.611362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.611718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.612142 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.612504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.612855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.613220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.613583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.613944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.614334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.614695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.615053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.615416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.615777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.616133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.616493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.616852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.617247 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.617685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.618217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.618554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.619050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.619431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.620057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.620416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.620801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.621211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.621586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.621944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.622340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.622729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.623077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.623427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.623782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.624133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.624478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.624851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.625200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.625540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.625907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.626282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.626950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.627463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.627953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.628392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.628768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.629184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.629663 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.630154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.630516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.630866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.631235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.631591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.631939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.632299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.632649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.633008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.633356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.633708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.634083 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.634463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.634814 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.635158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.635515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.635868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.636330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.636833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.637218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.637630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.638018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.638420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.638778 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.639127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.639489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.639829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.640188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.640537 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.640916 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.641262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.641636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.641948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.642332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.642703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.643062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.643415 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.643829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.644189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.644854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.645249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.645615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.646046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.646431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.646782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.647127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.647480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.647849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.648272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.648567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.648922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.649275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.649627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.649980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.650363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.650718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.651073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.651427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.651830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.652244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.652607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.652970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.653331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.653688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.654059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.654422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.654773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.655134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.655522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.655879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.656225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.656725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.657084 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.657455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.657821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.658206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.658592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.659130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.659559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.659981 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.660352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.660702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.661108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.661522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.662079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.662505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.662877 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.663304 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.663830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.664400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.664824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.665331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.665697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.666929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.666929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.667460 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.667859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.668110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.668409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.668776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.669148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.669524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.669972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.670441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.670809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.671279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.671604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.671984 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.672341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.672716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.673074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.673447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.673818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.674217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.674569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.674955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.675313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.675979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.676340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.676695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.677051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.677414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.677795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.678198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.678550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.678926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.679290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.679655 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.680017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.680373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.680750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.681107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.681469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.681823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.682209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.682571 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.682936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.683309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.683885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.684261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.684637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.685045 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.685397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.685794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.686199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:44.686486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100564) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 21 14:37:44.732072 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-33217458-69ab-4f9e-ad33-122998519287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100564) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:37:45.096007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.context [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee5823f9-95bd-47be-a7d6-f14717896ffb(cell1) {{(pid=100564) load_cells /opt/stack/nova/nova/context.py:466}} Apr 21 14:37:45.102187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:37:45.104291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:37:45.105581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:37:45.109430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:37:45.143777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-33217458-69ab-4f9e-ad33-122998519287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100564) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:37:45.144763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-33217458-69ab-4f9e-ad33-122998519287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100564) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:37:45.185477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-33217458-69ab-4f9e-ad33-122998519287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100564) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:37:45.203035 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 21 14:37:45.203586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 21 14:37:45.207034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 21 14:37:45.207866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 21 14:37:45.208398 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 21 14:37:45.209245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.209931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.210743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.211403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.212390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.212992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.213603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.214241 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.215425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.215549 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.216214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.216869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786385-2-iscsi {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.217579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.218251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.218921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.219610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.220639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.221362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.222069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.223357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.224066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.224743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.225723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.226537 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.227221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.227892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.228762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.229440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.230204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.230941 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.231642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786385-2-iscsi {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.232343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.233033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.233716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.234751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.235390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.236307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.237019 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.237722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.238415 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.239105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.239805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.240510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.241225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.241892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.242596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.243270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.243986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.244636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.245299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.245871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.246598 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.247393 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.248109 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.248824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.249371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.249922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.250684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.251409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.252099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.252940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.253612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.254360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.255930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.255930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.256339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.257016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.258164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.258371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.259041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.259690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.260694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.261215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.261821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.262539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.263374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.264386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.264744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.265459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.266187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.266871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.267518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.268198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.268903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.269585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.270223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.270734 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.271349 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.271991 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.272693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.273357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.274100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.274722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.275374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.276081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.276671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.277039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 21 14:37:45.277039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: from cryptography.utils import int_from_bytes Apr 21 14:37:45.277325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.277498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 21 14:37:45.277498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: from cryptography.utils import int_from_bytes Apr 21 14:37:45.277907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.278802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.279462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.280130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.280732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.281642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.282394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.283086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.283755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.284429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.285146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.285868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.286384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.287039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.287687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.288384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.289097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.289731 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.290428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.291100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.291743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.292432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.293158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.293825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.294503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.295162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.295832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.296670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.297817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.298679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.299658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.300511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.301671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.302553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.303511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.304396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.305246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.306121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.307055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.307982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 21 14:37:45.308749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.309462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.310192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.311010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.311931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.312852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.313835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.314821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.315768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.317060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.317772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.318529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.319240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.319992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.320619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.321341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.322140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.324522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.324522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.324522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.324948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.325656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.326355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.327263 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.328022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.328777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.329462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.330194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.330969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.331669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.332357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.333329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.333713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.334484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.335164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.335873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.336624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.337389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.338107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.338765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.339417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.340093 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.340779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.341458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.342238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.342965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.343657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.344442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.345122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.345767 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.346706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.347376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.348068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.348756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.349429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.350198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.350911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.351591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.352287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.352940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.353607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.354265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.354656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.355148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.355883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.356602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.357350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.358061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.359678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.360344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.360995 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.361712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.362502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.363202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.363881 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.364592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.365277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.366040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.366723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.367405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.368065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.368736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.369403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.370119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.370873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.371672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.372371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.373043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.373733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.374473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.375081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.375671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.376287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.376950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.377645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.378392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.379081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.379485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Loading Gnome Apr 21 14:37:45.379708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.380595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.381485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.382223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.382869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.384022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.384145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.384810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.385501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.386289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.387041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.387678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.388383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.389593 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.389779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.390400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.390995 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.391605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.392214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.392838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.393461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.394138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.394811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.395516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.396215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.396909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.397596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.398344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.399862 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.403457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.403457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.403457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.403790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Loading Google Apr 21 14:37:45.405064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.405734 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.406232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Loading Windows (alt) Apr 21 14:37:45.406454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.407420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.408352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.409130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.409823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.410725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.411447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.412750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.412922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Loading file Apr 21 14:37:45.413049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.413540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.413682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Loading keyczar Apr 21 14:37:45.414026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Loading multi Apr 21 14:37:45.414334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.415007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Loading pyfs Apr 21 14:37:45.415133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.415693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.416387 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.417125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.418074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.418672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.419372 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.420068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.420748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.421635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.422172 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.422874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.423568 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.424280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.424967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.425962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.426718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.428092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.428839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.429537 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.431435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.431435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.431646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.432496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.433211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.433737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.434160 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.434550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.434927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.435310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.435698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.436070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.436443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.436812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.437182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.437551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.437912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.438314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.438679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.439059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.439420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.439793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.440162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.440533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.440970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.441337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.441701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.442777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.442777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.442777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.443186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.443857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.444272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.444612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.444977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.445378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.445741 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.446123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.446496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.446862 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.447221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.447592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.447971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.448339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.449398 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.449398 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.449763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.449933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.450186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.451064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.451064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.451399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.451594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.452281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.452281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.452610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.453070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.453380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.454044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.454246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.454493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.454938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.455320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.455684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.456306 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.456494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.456723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.457085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.457448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.457812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.458208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.458568 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.458928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.459287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.459679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.460045 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.460404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.461316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.461316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.461635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.461796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.462333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.463168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.463168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.463502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.463743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.464120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.464489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.464921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.465291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.465672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.466067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.466400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.466762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.467129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.467703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.468074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.468439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.468818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.469207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.469566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.469931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.470427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.470675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.471200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.471492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.471753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.472010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.472387 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.472755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.473119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.473479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.473849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.474271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.474905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.475143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.475350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.475664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.478063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.478063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.478063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.478063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.478063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.478063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.479143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.479143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.479143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.479627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.479627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.479940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.480505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.480759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.481365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.481541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.481803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.482194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.482560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.483368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.483567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.483835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.484356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.484532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.484890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.485247 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.485626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.487746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.488360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.488578 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.489004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.489382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.489764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.490199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.490587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.490967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.491333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.491722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.492090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.492481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.492865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.493236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.493621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.494054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.495018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.495386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.495774 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.498053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.498053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.498053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.498053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.498053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.498931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.498931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.498931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.499373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.499539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.499878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.500264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.500627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.500994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.501366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.501732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.502152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.502518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.503041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.503355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.503678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.504058 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.504438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.504802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.505169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.505552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.505918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.506310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.506681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.507036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.507446 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.507809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.508186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.508581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.508973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.509339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.509733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.510164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.510535 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.510925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.511313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.511950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.512124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.513366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.513725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.514134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.514515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.514890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.515260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.515628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.515994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.516389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.516755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.517144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.517514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.517878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.518274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.518637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.519039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.519399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.519798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.520182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.520566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.520955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.521321 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.521795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.522196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.522574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.522952 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.523317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.523928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.524105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.524393 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.524765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.526076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.526076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.526076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.526611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.526944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.527394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.528148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.528148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.528476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.528803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.529167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.529539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.529901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.530293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.531122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.531122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.531566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.532048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.532340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.532711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.533082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.533459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.533909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.534320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.534677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.535056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.535501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.535885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.536261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.536625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.537007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.537381 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.537755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.538132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.538500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.538871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.539268 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.539671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.540046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.540415 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.540781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.541148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.541808 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.542264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.542651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.543071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.543458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.543836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.544219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.544605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.544965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.545326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.545688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.546370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.546742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.547132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.547491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.548144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.548322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.548563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.549347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.549612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.550347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.551105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.551484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.551865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.552207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.552761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.555748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.555748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.555748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.555748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.555748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.556193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.557060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.557060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.557320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.557678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.558113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.558536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.558916 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.559288 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.559661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.560040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.560455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.560822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.561191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.561564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.561942 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.562610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.562989 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.563367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.563744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.564106 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.564476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.564841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.565243 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.565610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.565972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.566428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.566801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.567189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.567555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.568267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.568429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.568674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.569358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.569757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.570223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.570718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.571153 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.571751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.572309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.572764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.573179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.573659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.575002 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.575675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.576708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.576708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.576953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.577329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.577758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.578339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.578899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.579776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.580270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.580744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.581029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.581834 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.581961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.582435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.583253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.583944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.585279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.585807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.586371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.586922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.587603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.588170 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.588796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.589439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.590299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.591231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.591231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.591591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.592289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.592289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.592576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.592929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.593308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.593851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.594164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.595155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.595284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.595584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.595963 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.596335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.596708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.597080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.597451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.597833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.598239 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.598633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.599007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.599366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.599784 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.600429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.600799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.601179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.601549 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.601920 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.602353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.603386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.603386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.603386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.603867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.604117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.604502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.605165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.605528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.605894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.606335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.606700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.607090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.607463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.607840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.608209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.608705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.608991 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.609378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.609735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.610297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.610876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.611745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.611745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.612219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.612836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.612836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.613334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.613334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.613805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.614117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.614849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.614849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.615681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.615681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.616041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.616417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.616788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.617792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.617792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 21 14:37:45.617792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 21 14:37:45.659036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:37:45.727005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-33217458-69ab-4f9e-ad33-122998519287 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 14:37:45.734774 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 14:37:45.939760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.context [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee5823f9-95bd-47be-a7d6-f14717896ffb(cell1) {{(pid=100563) load_cells /opt/stack/nova/nova/context.py:466}} Apr 21 14:37:45.945315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:37:45.947220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:37:45.948118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:37:45.951098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:37:45.977242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:37:45.992406 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:37:46.028605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 21 14:37:46.082645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-33217458-69ab-4f9e-ad33-122998519287 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 14:37:46.088878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-33217458-69ab-4f9e-ad33-122998519287 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 14:37:46.095056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x56151342a9c0 pid: 100564 (default app) Apr 21 14:37:46.121896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 21 14:37:46.121896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: from cryptography.utils import int_from_bytes Apr 21 14:37:46.122279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 21 14:37:46.122279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: from cryptography.utils import int_from_bytes Apr 21 14:37:46.203904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Loading Gnome Apr 21 14:37:46.229157 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Loading Google Apr 21 14:37:46.232747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Loading Windows (alt) Apr 21 14:37:46.237715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Loading file Apr 21 14:37:46.239103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Loading keyczar Apr 21 14:37:46.239545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Loading multi Apr 21 14:37:46.240430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Loading pyfs Apr 21 14:37:46.547819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 14:37:46.555698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 14:37:46.906655 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 14:37:46.912545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-76fe2e16-8370-480a-8190-0d9a83815444 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 14:37:46.920026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x56151342a9c0 pid: 100563 (default app) Apr 21 14:38:29.098555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f4ba6eda-a21a-462c-85c3-3980a1d4e7ca tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] Action: 'create', calling method: .version_select at 0x7f19e07f9268>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-307801015", "metadata": {"Type": "work"}}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:38:29.810399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3e6c712-70b0-4fb5-8b67-cf22c91f375f tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Action: 'create', calling method: .version_select at 0x7f19e07f8268>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1173547733", "metadata": {"Type": "work"}}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:38:29.813518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3e6c712-70b0-4fb5-8b67-cf22c91f375f tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:38:29.822843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a3e6c712-70b0-4fb5-8b67-cf22c91f375f tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.977099 Apr 21 14:38:29.825371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1146 bytes} [Wed Apr 21 14:38:26 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 2991 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:38:30.232071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-390629698", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "networks": [{"uuid": "2671739c-b1e5-44b5-80f6-19a324e449de"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:38:31.427667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] validate_networks() for [('2671739c-b1e5-44b5-80f6-19a324e449de', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:38:32.162314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f4ba6eda-a21a-462c-85c3-3980a1d4e7ca tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 5.716276 Apr 21 14:38:32.163736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 1/2] 10.222.0.24 () {60 vars in 1146 bytes} [Wed Apr 21 14:38:26 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 5722 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 21 14:38:32.212990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-362e0865-1681-4126-a203-309967f8ad65 tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Action: 'create', calling method: .version_select at 0x7f19e07f9ae8>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1206557177", "metadata": {"Type": "work"}}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:38:32.222889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-362e0865-1681-4126-a203-309967f8ad65 tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:38:32.229018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-362e0865-1681-4126-a203-309967f8ad65 tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.060038 Apr 21 14:38:32.236329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 2/3] 10.222.0.24 () {60 vars in 1146 bytes} [Wed Apr 21 14:38:32 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:38:32.258898 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-679a22aa-fc96-4540-bafa-79efcdb562e8 tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] Calling method '.version_select at 0x7f19e071a1e0>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:32.606814 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-679a22aa-fc96-4540-bafa-79efcdb562e8 tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a" status: 200 len: 352 microversion: 2.1 time: 0.367912 Apr 21 14:38:32.613051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 3/4] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:38:32 2021] GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a => generated 352 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:38:32.626714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-282872c6-e641-4a45-a330-6e500df7300e tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Action: 'create', calling method: .version_select at 0x7f19e06fca60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-895806782", "metadata": {"Type": "work"}}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:38:32.629135 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-282872c6-e641-4a45-a330-6e500df7300e tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:38:32.630262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-282872c6-e641-4a45-a330-6e500df7300e tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021275 Apr 21 14:38:32.635397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 4/5] 10.222.0.24 () {60 vars in 1146 bytes} [Wed Apr 21 14:38:32 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:38:32.644892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-60eb485d-c527-41c5-b7a6-99535247e0db tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Calling method '.version_select at 0x7f19e071a488>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:32.822833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-60eb485d-c527-41c5-b7a6-99535247e0db tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] HTTP exception thrown: Volume tempest-invalid-1238800503 could not be found. Apr 21 14:38:32.824348 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-60eb485d-c527-41c5-b7a6-99535247e0db tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Returning 404 to user: Volume tempest-invalid-1238800503 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:38:32.825677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-60eb485d-c527-41c5-b7a6-99535247e0db tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1238800503" status: 404 len: 99 microversion: 2.1 time: 0.188338 Apr 21 14:38:32.826922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 5/6] 10.222.0.24 () {58 vars in 1208 bytes} [Wed Apr 21 14:38:32 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1238800503 => generated 99 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 21 14:38:32.843081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-811eef37-dcf4-410d-ad0c-eb7377f0a21c tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005165 Apr 21 14:38:32.855924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 6/7] 10.222.0.24 () {58 vars in 1130 bytes} [Wed Apr 21 14:38:32 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 21 14:38:32.870472 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f3d1a3d9-e683-414a-9f7d-3ec95c748d72 tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005363 Apr 21 14:38:32.875134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 7/8] 10.222.0.24 () {58 vars in 1127 bytes} [Wed Apr 21 14:38:32 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 21 14:38:32.889954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e0af728-4a15-44fc-be6f-fe0a6851dc0b tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Calling method '.version_select at 0x7f19e06fca60>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:33.002376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-7e0af728-4a15-44fc-be6f-fe0a6851dc0b tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] HTTP exception thrown: Volume df4aa815-0303-4ee0-b807-2df7f527bcfd could not be found. Apr 21 14:38:33.004619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e0af728-4a15-44fc-be6f-fe0a6851dc0b tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Returning 404 to user: Volume df4aa815-0303-4ee0-b807-2df7f527bcfd could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:38:33.006726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7e0af728-4a15-44fc-be6f-fe0a6851dc0b tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/df4aa815-0303-4ee0-b807-2df7f527bcfd" status: 404 len: 109 microversion: 2.1 time: 0.125608 Apr 21 14:38:33.008835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 8/9] 10.222.0.24 () {58 vars in 1238 bytes} [Wed Apr 21 14:38:32 2021] DELETE /compute/v2.1/os-volumes/df4aa815-0303-4ee0-b807-2df7f527bcfd => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:38:33.033270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed6b7612-b65a-4d4e-95b5-457168465762 tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Calling method '.version_select at 0x7f19e06fcb70>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:33.191791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-ed6b7612-b65a-4d4e-95b5-457168465762 tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] HTTP exception thrown: Volume f2b77072-8b96-4e15-a0c2-d7dea193ce1e could not be found. Apr 21 14:38:33.192487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed6b7612-b65a-4d4e-95b5-457168465762 tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] Returning 404 to user: Volume f2b77072-8b96-4e15-a0c2-d7dea193ce1e could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:38:33.193423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed6b7612-b65a-4d4e-95b5-457168465762 tempest-VolumesNegativeTest-2096475548 tempest-VolumesNegativeTest-2096475548-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/f2b77072-8b96-4e15-a0c2-d7dea193ce1e" status: 404 len: 109 microversion: 2.1 time: 0.178606 Apr 21 14:38:33.195179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 9/10] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:38:33 2021] GET /compute/v2.1/os-volumes/f2b77072-8b96-4e15-a0c2-d7dea193ce1e => generated 109 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:38:34.095750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1522639667", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "networks": [{"uuid": "d7586439-5692-45b4-a121-4de98b0d3272"}]}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:38:34.349250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] validate_networks() for [('d7586439-5692-45b4-a121-4de98b0d3272', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:38:34.736820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:38:34.737888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:38:34.739046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:38:34.740114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:38:34.740951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:38:34.759431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:34.760792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:34.762738 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:34.763547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:34.799881 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Getting quotas for project dedd46ed5a7b480b96fc0f889ee9392f. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:38:34.809131 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Getting quotas for user 03c90025246146098edf50012bef2ed5 and project dedd46ed5a7b480b96fc0f889ee9392f. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:38:34.829292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:38:34.834897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:38:34.996817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e8df7428-1a64-40eb-99f9-48e27a47f65a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.169858 Apr 21 14:38:35.005225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 2/11] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:38:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 5172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:38:35.017233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fbb442c4-9613-48bc-82d0-5fd36efa19ca tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] Calling method '.version_select at 0x7f19e06dfbf8>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:35.399286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fbb442c4-9613-48bc-82d0-5fd36efa19ca tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a" status: 200 len: 353 microversion: 2.1 time: 0.390942 Apr 21 14:38:35.402842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 3/12] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:38:35 2021] GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a => generated 353 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:38:35.438040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-110a6db5-3fbb-4dae-9e7d-a0d426f5d733 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:35.438488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-110a6db5-3fbb-4dae-9e7d-a0d426f5d733 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:35.743587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-110a6db5-3fbb-4dae-9e7d-a0d426f5d733 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:35.801096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-110a6db5-3fbb-4dae-9e7d-a0d426f5d733 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1214 microversion: 2.1 time: 0.392885 Apr 21 14:38:35.801945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 4/13] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:35 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1214 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:35.818339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f3bc543-8762-4be7-bcfc-91571291b351 tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] Calling method '.version_select at 0x7f19e069d2f0>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:36.176051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f3bc543-8762-4be7-bcfc-91571291b351 tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a" status: 200 len: 353 microversion: 2.1 time: 0.361748 Apr 21 14:38:36.177084 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 5/14] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:38:35 2021] GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a => generated 353 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:38:36.200341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-13ddd3eb-04ae-4275-b07a-bf53c03ed276 tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] Calling method '.version_select at 0x7f19dfde3f28>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:36.519829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-13ddd3eb-04ae-4275-b07a-bf53c03ed276 tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a" status: 202 len: 0 microversion: 2.1 time: 0.326048 Apr 21 14:38:36.524580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 6/15] 10.222.0.24 () {58 vars in 1238 bytes} [Wed Apr 21 14:38:36 2021] DELETE /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:38:36.531200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2eb568c3-a6d5-47bb-8f3e-c34b92238883 tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] Calling method '.version_select at 0x7f19dfd7a2f0>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:36.774697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2eb568c3-a6d5-47bb-8f3e-c34b92238883 tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a" status: 200 len: 352 microversion: 2.1 time: 0.248600 Apr 21 14:38:36.775490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 7/16] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:38:36 2021] GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a => generated 352 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:38:36.819938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-67fdd4ad-7739-4592-bddd-51d3c7d5858b tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:36.820675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-67fdd4ad-7739-4592-bddd-51d3c7d5858b tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:37.030297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-67fdd4ad-7739-4592-bddd-51d3c7d5858b tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:37.040793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-67fdd4ad-7739-4592-bddd-51d3c7d5858b tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1214 microversion: 2.1 time: 0.224820 Apr 21 14:38:37.041641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 8/17] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:36 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:38:37.788741 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bc492b2d-ed2c-41f7-95e8-9dd1e11c541b tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] Calling method '.version_select at 0x7f19dfdbfc80>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:37.973227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-bc492b2d-ed2c-41f7-95e8-9dd1e11c541b tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] HTTP exception thrown: Volume 5bee4846-9f7f-4ff0-acc8-f6f26bf6874a could not be found. Apr 21 14:38:37.974193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bc492b2d-ed2c-41f7-95e8-9dd1e11c541b tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] Returning 404 to user: Volume 5bee4846-9f7f-4ff0-acc8-f6f26bf6874a could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:38:37.975718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bc492b2d-ed2c-41f7-95e8-9dd1e11c541b tempest-VolumesGetTestJSON-1941325972 tempest-VolumesGetTestJSON-1941325972-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a" status: 404 len: 109 microversion: 2.1 time: 0.191198 Apr 21 14:38:37.977155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 9/18] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:38:37 2021] GET /compute/v2.1/os-volumes/5bee4846-9f7f-4ff0-acc8-f6f26bf6874a => generated 109 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 21 14:38:38.062878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b664132f-7059-4dd0-9c5f-1119a48a5579 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:38.067850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b664132f-7059-4dd0-9c5f-1119a48a5579 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:38.104011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b664132f-7059-4dd0-9c5f-1119a48a5579 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:38.111079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b664132f-7059-4dd0-9c5f-1119a48a5579 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:38.113346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b664132f-7059-4dd0-9c5f-1119a48a5579 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:38.123592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b664132f-7059-4dd0-9c5f-1119a48a5579 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:38.470700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b664132f-7059-4dd0-9c5f-1119a48a5579 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:38.484257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b664132f-7059-4dd0-9c5f-1119a48a5579 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1218 microversion: 2.1 time: 0.426175 Apr 21 14:38:38.485034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 10/19] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:38 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1218 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:39.507482 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-351e9a2b-9ae7-4f9a-933d-a36b6b9209cf tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:39.512342 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-351e9a2b-9ae7-4f9a-933d-a36b6b9209cf tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:39.559832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-351e9a2b-9ae7-4f9a-933d-a36b6b9209cf tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:39.561108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-351e9a2b-9ae7-4f9a-933d-a36b6b9209cf tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:39.563307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-351e9a2b-9ae7-4f9a-933d-a36b6b9209cf tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:39.564520 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-351e9a2b-9ae7-4f9a-933d-a36b6b9209cf tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:39.916697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-351e9a2b-9ae7-4f9a-933d-a36b6b9209cf tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:39.932748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-351e9a2b-9ae7-4f9a-933d-a36b6b9209cf tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1274 microversion: 2.1 time: 0.433183 Apr 21 14:38:39.935180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 11/20] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:39 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1274 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:40.081223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:38:40.082610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:38:40.083932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:38:40.085094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:38:40.086269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:38:40.137359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:40.142102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:40.144843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:40.152021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:40.265841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Getting quotas for project c273beec5c4c4f89a4c7c896497de7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:38:40.288468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Getting quotas for user fc4c490791d14d0981977c2544a8f9c5 and project c273beec5c4c4f89a4c7c896497de7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:38:40.351585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:38:40.358227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:38:40.626075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f801383a-51c7-4ac0-889a-d2d1f4776232 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.230856 Apr 21 14:38:40.627348 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 10/21] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:38:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 7235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:38:40.654316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-57e0eb91-2863-45b6-8753-c4de143eda9b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:40.655987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-57e0eb91-2863-45b6-8753-c4de143eda9b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:40.906143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-57e0eb91-2863-45b6-8753-c4de143eda9b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:40.943252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-57e0eb91-2863-45b6-8753-c4de143eda9b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1218 microversion: 2.1 time: 0.288521 Apr 21 14:38:40.944782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 12/22] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:40 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1218 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:40.993191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a4009d2c-797f-4148-a323-43016812e813 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:40.996128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a4009d2c-797f-4148-a323-43016812e813 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:41.069701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4009d2c-797f-4148-a323-43016812e813 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:41.088367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4009d2c-797f-4148-a323-43016812e813 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:41.090206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4009d2c-797f-4148-a323-43016812e813 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:41.091109 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4009d2c-797f-4148-a323-43016812e813 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:41.978563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-844e9b6d-7cea-444c-9d87-9995fe517905 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:41.979740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-844e9b6d-7cea-444c-9d87-9995fe517905 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:42.429866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-844e9b6d-7cea-444c-9d87-9995fe517905 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:42.469397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-844e9b6d-7cea-444c-9d87-9995fe517905 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1218 microversion: 2.1 time: 0.489991 Apr 21 14:38:42.478858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 13/23] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:41 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1218 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:43.515508 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-37f236f2-2ebd-4aa6-9b15-faed3181bda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:43.534795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-37f236f2-2ebd-4aa6-9b15-faed3181bda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:43.575721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37f236f2-2ebd-4aa6-9b15-faed3181bda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:43.598021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37f236f2-2ebd-4aa6-9b15-faed3181bda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:43.602136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37f236f2-2ebd-4aa6-9b15-faed3181bda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:43.607666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37f236f2-2ebd-4aa6-9b15-faed3181bda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:44.426651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-37f236f2-2ebd-4aa6-9b15-faed3181bda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:44.459982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-37f236f2-2ebd-4aa6-9b15-faed3181bda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1214 microversion: 2.1 time: 0.953492 Apr 21 14:38:44.475949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 14/24] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:43 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1214 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:45.511349 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8d49dff8-a856-4ab3-be93-be26d96e5110 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:45.515692 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8d49dff8-a856-4ab3-be93-be26d96e5110 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:45.580628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d49dff8-a856-4ab3-be93-be26d96e5110 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:45.582584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d49dff8-a856-4ab3-be93-be26d96e5110 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:45.586705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d49dff8-a856-4ab3-be93-be26d96e5110 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:45.591936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d49dff8-a856-4ab3-be93-be26d96e5110 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:46.138370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a4009d2c-797f-4148-a323-43016812e813 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:46.166829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a4009d2c-797f-4148-a323-43016812e813 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 5.202558 Apr 21 14:38:46.172584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 11/25] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:40 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 5216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:46.455872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8d49dff8-a856-4ab3-be93-be26d96e5110 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:46.480063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8d49dff8-a856-4ab3-be93-be26d96e5110 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1278 microversion: 2.1 time: 0.977730 Apr 21 14:38:46.481137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 15/26] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:45 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1278 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:38:47.188671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-92c1d54e-3609-44ba-b5c4-36b0f1095f34 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:47.190140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-92c1d54e-3609-44ba-b5c4-36b0f1095f34 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:47.221778 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-92c1d54e-3609-44ba-b5c4-36b0f1095f34 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:47.223411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-92c1d54e-3609-44ba-b5c4-36b0f1095f34 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:47.226916 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-92c1d54e-3609-44ba-b5c4-36b0f1095f34 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:47.231021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-92c1d54e-3609-44ba-b5c4-36b0f1095f34 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:47.514780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-299ec682-720d-4810-977d-bf2943706257 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:47.515443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-299ec682-720d-4810-977d-bf2943706257 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:47.535836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-299ec682-720d-4810-977d-bf2943706257 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:47.554608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-299ec682-720d-4810-977d-bf2943706257 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:47.556126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-299ec682-720d-4810-977d-bf2943706257 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:47.556804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-299ec682-720d-4810-977d-bf2943706257 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:50.303812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-299ec682-720d-4810-977d-bf2943706257 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:50.329574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-299ec682-720d-4810-977d-bf2943706257 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1276 microversion: 2.1 time: 2.818407 Apr 21 14:38:50.331978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 16/27] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:47 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1276 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:38:51.372184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4dab752d-a0a4-449a-bfbb-97d3787e82e3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:51.377237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4dab752d-a0a4-449a-bfbb-97d3787e82e3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:51.418798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4dab752d-a0a4-449a-bfbb-97d3787e82e3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:51.436661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4dab752d-a0a4-449a-bfbb-97d3787e82e3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:51.443863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4dab752d-a0a4-449a-bfbb-97d3787e82e3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:51.445073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4dab752d-a0a4-449a-bfbb-97d3787e82e3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:52.216548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4dab752d-a0a4-449a-bfbb-97d3787e82e3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:52.262097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4dab752d-a0a4-449a-bfbb-97d3787e82e3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1276 microversion: 2.1 time: 0.897412 Apr 21 14:38:52.274555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 17/28] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:51 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1276 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:52.767788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-92c1d54e-3609-44ba-b5c4-36b0f1095f34 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:52.795023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-92c1d54e-3609-44ba-b5c4-36b0f1095f34 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 5.611387 Apr 21 14:38:52.805934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 12/29] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:47 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 5624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:38:53.306526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c93c359b-011c-4332-9aa8-7433dcfb61e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:53.311913 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c93c359b-011c-4332-9aa8-7433dcfb61e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:53.356476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c93c359b-011c-4332-9aa8-7433dcfb61e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:53.357117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c93c359b-011c-4332-9aa8-7433dcfb61e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:53.358147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c93c359b-011c-4332-9aa8-7433dcfb61e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:53.358775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c93c359b-011c-4332-9aa8-7433dcfb61e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:53.813620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-da9a76d0-1334-4049-96b0-c7de3b9af43e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:53.814495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-da9a76d0-1334-4049-96b0-c7de3b9af43e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:53.829717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da9a76d0-1334-4049-96b0-c7de3b9af43e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:53.833195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da9a76d0-1334-4049-96b0-c7de3b9af43e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:53.835208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da9a76d0-1334-4049-96b0-c7de3b9af43e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:53.837813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da9a76d0-1334-4049-96b0-c7de3b9af43e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:54.272127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c93c359b-011c-4332-9aa8-7433dcfb61e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:54.301469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c93c359b-011c-4332-9aa8-7433dcfb61e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1276 microversion: 2.1 time: 1.000520 Apr 21 14:38:54.305395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 18/30] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:53 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1276 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:55.364253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5bdbdfb0-5243-4af2-874e-3889c65e86e8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:55.365712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5bdbdfb0-5243-4af2-874e-3889c65e86e8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:55.436347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5bdbdfb0-5243-4af2-874e-3889c65e86e8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:55.476013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5bdbdfb0-5243-4af2-874e-3889c65e86e8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:55.485001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5bdbdfb0-5243-4af2-874e-3889c65e86e8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:55.486009 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5bdbdfb0-5243-4af2-874e-3889c65e86e8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:57.241728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da9a76d0-1334-4049-96b0-c7de3b9af43e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:57.304376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-da9a76d0-1334-4049-96b0-c7de3b9af43e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 3.494534 Apr 21 14:38:57.311262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 13/31] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:53 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 3503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:58.036351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5bdbdfb0-5243-4af2-874e-3889c65e86e8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:58.070509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5bdbdfb0-5243-4af2-874e-3889c65e86e8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 2.737746 Apr 21 14:38:58.071729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 19/32] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:55 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 2741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:38:58.104687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-8abb6713-ea46-4bc3-85a8-1f24cb359438 req-03f5cee3-adb9-4fef-9223-593518a994dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9", "tag": "b0343fc5-ddf4-4954-92f9-5f7c45aaf301"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:38:58.112696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:38:58.112696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:38:58.171515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-8abb6713-ea46-4bc3-85a8-1f24cb359438 req-03f5cee3-adb9-4fef-9223-593518a994dd service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:58.195361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-8abb6713-ea46-4bc3-85a8-1f24cb359438 req-03f5cee3-adb9-4fef-9223-593518a994dd service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:58.280363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-8abb6713-ea46-4bc3-85a8-1f24cb359438 req-03f5cee3-adb9-4fef-9223-593518a994dd service nova] Creating event network-changed:b0343fc5-ddf4-4954-92f9-5f7c45aaf301 for instance 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 on hv-cinder-78638 Apr 21 14:38:58.283132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-8abb6713-ea46-4bc3-85a8-1f24cb359438 req-03f5cee3-adb9-4fef-9223-593518a994dd service nova] Acquired lock "compute-rpcapi-router" {{(pid=100564) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 21 14:38:58.286202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34cfe8f1-7c6d-4148-a15d-659713460cb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:58.287400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34cfe8f1-7c6d-4148-a15d-659713460cb5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:58.290262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34cfe8f1-7c6d-4148-a15d-659713460cb5 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:58.291446 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34cfe8f1-7c6d-4148-a15d-659713460cb5 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:58.316659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.compute.rpcapi [None req-34cfe8f1-7c6d-4148-a15d-659713460cb5 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 21 14:38:58.318850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34cfe8f1-7c6d-4148-a15d-659713460cb5 None None] Releasing lock "compute-rpcapi-router" {{(pid=100564) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 21 14:38:58.347035 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8f0e4095-ea33-4626-bb93-0c4027661e21 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:58.351232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8f0e4095-ea33-4626-bb93-0c4027661e21 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:58.391284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f0e4095-ea33-4626-bb93-0c4027661e21 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:58.393686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f0e4095-ea33-4626-bb93-0c4027661e21 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:58.396304 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f0e4095-ea33-4626-bb93-0c4027661e21 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:58.397661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f0e4095-ea33-4626-bb93-0c4027661e21 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:58.422594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34cfe8f1-7c6d-4148-a15d-659713460cb5 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.108419 Apr 21 14:38:58.424622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 14/33] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:38:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:38:59.125957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b0b69e96-71d7-4a0a-bd32-97f9e34abfd3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:38:59.137259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b0b69e96-71d7-4a0a-bd32-97f9e34abfd3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:38:59.223446 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0b69e96-71d7-4a0a-bd32-97f9e34abfd3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:59.224295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0b69e96-71d7-4a0a-bd32-97f9e34abfd3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:59.239340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0b69e96-71d7-4a0a-bd32-97f9e34abfd3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:38:59.239872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0b69e96-71d7-4a0a-bd32-97f9e34abfd3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:38:59.725063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8f0e4095-ea33-4626-bb93-0c4027661e21 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:38:59.738672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8f0e4095-ea33-4626-bb93-0c4027661e21 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 1.399820 Apr 21 14:38:59.742800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 20/34] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:58 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:00.264188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0b69e96-71d7-4a0a-bd32-97f9e34abfd3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:00.316615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b0b69e96-71d7-4a0a-bd32-97f9e34abfd3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 1.219732 Apr 21 14:39:00.330567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 15/35] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:38:59 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:00.453457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2bea0430-5019-4887-9009-8ce386cce85a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'create', calling method: .version_select at 0x7f19e07f8a60>, body: {"keypair": {"name": "tempest-keypair-1218522724"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:00.646413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-2bea0430-5019-4887-9009-8ce386cce85a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:39:00.664995 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-2bea0430-5019-4887-9009-8ce386cce85a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for user ff12725509264be384462a84ea6aaf64 and project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:39:00.765502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f0938e4d-ebfa-49fd-9476-315554be0c88 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:00.766832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f0938e4d-ebfa-49fd-9476-315554be0c88 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:00.816653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0938e4d-ebfa-49fd-9476-315554be0c88 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:00.823768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0938e4d-ebfa-49fd-9476-315554be0c88 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:00.825811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0938e4d-ebfa-49fd-9476-315554be0c88 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:00.827093 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0938e4d-ebfa-49fd-9476-315554be0c88 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:00.988235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-2bea0430-5019-4887-9009-8ce386cce85a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:39:00.997819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-2bea0430-5019-4887-9009-8ce386cce85a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for user ff12725509264be384462a84ea6aaf64 and project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:39:01.037330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2bea0430-5019-4887-9009-8ce386cce85a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.292427 Apr 21 14:39:01.040779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 21/36] 10.222.0.24 () {62 vars in 1189 bytes} [Wed Apr 21 14:38:59 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1297 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:39:01.226078 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f0938e4d-ebfa-49fd-9476-315554be0c88 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:01.237516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f0938e4d-ebfa-49fd-9476-315554be0c88 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 0.479638 Apr 21 14:39:01.248978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 16/37] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:00 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:39:01.353512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a370db03-3639-4fbe-9980-73b693f75c27 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:01.356321 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a370db03-3639-4fbe-9980-73b693f75c27 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:01.383167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a370db03-3639-4fbe-9980-73b693f75c27 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:01.384815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a370db03-3639-4fbe-9980-73b693f75c27 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:01.388613 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a370db03-3639-4fbe-9980-73b693f75c27 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:01.393006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a370db03-3639-4fbe-9980-73b693f75c27 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:02.259279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-61945e17-1c4f-4836-ab78-4a80790ca245 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:02.261063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-61945e17-1c4f-4836-ab78-4a80790ca245 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:02.271370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61945e17-1c4f-4836-ab78-4a80790ca245 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:02.272130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61945e17-1c4f-4836-ab78-4a80790ca245 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:02.273178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61945e17-1c4f-4836-ab78-4a80790ca245 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:02.273821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61945e17-1c4f-4836-ab78-4a80790ca245 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:03.869861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-61945e17-1c4f-4836-ab78-4a80790ca245 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:03.872075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a370db03-3639-4fbe-9980-73b693f75c27 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:03.899496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-61945e17-1c4f-4836-ab78-4a80790ca245 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 1.645976 Apr 21 14:39:03.914008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 17/38] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:02 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:03.920332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a370db03-3639-4fbe-9980-73b693f75c27 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 2.580839 Apr 21 14:39:03.945595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 22/39] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:01 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:04.923547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-67b9656b-19b1-460d-85c3-657ae0ccbe71 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:04.924765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-67b9656b-19b1-460d-85c3-657ae0ccbe71 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:04.980317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67b9656b-19b1-460d-85c3-657ae0ccbe71 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:04.981158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67b9656b-19b1-460d-85c3-657ae0ccbe71 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:04.982625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67b9656b-19b1-460d-85c3-657ae0ccbe71 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:04.983465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67b9656b-19b1-460d-85c3-657ae0ccbe71 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:05.292608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-61688255", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bacac062-2ca2-4bed-9f00-1f32f650b8c7"}]}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:05.698471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] validate_networks() for [('bacac062-2ca2-4bed-9f00-1f32f650b8c7', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:39:06.334670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-67b9656b-19b1-460d-85c3-657ae0ccbe71 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:06.369793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-67b9656b-19b1-460d-85c3-657ae0ccbe71 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 1.454397 Apr 21 14:39:06.376848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 23/40] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:04 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:06.402328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4ffac712-7396-4fbd-9dc5-f95ad8c92a01 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:06.404577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4ffac712-7396-4fbd-9dc5-f95ad8c92a01 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:06.441197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ffac712-7396-4fbd-9dc5-f95ad8c92a01 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:06.443023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ffac712-7396-4fbd-9dc5-f95ad8c92a01 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:06.448006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ffac712-7396-4fbd-9dc5-f95ad8c92a01 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:06.450581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ffac712-7396-4fbd-9dc5-f95ad8c92a01 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:08.361390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4ffac712-7396-4fbd-9dc5-f95ad8c92a01 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:08.414461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4ffac712-7396-4fbd-9dc5-f95ad8c92a01 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 2.034054 Apr 21 14:39:08.419513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 24/41] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:06 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:08.452505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f71d7ee-31a6-4d9e-a917-328926a88267 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:08.454403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f71d7ee-31a6-4d9e-a917-328926a88267 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:08.472914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ee-31a6-4d9e-a917-328926a88267 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:08.474334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ee-31a6-4d9e-a917-328926a88267 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:08.476588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ee-31a6-4d9e-a917-328926a88267 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:08.477849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ee-31a6-4d9e-a917-328926a88267 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:09.877816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3f71d7ee-31a6-4d9e-a917-328926a88267 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:09.901858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f71d7ee-31a6-4d9e-a917-328926a88267 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 1.478814 Apr 21 14:39:09.913901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 25/42] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:08 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:10.452769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-af6df301-a964-47e1-b3cf-7cb5eb2cae42 req-ad8fb61d-02ae-46d9-a391-d87e93be904f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502a82df-ee66-408d-ab9e-8207516c0415", "tag": "e2c31a01-40a4-4b6e-aaee-cbeb1067272f"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:10.460189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:39:10.460189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:39:10.523868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-af6df301-a964-47e1-b3cf-7cb5eb2cae42 req-ad8fb61d-02ae-46d9-a391-d87e93be904f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:10.530467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-af6df301-a964-47e1-b3cf-7cb5eb2cae42 req-ad8fb61d-02ae-46d9-a391-d87e93be904f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:10.614185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-af6df301-a964-47e1-b3cf-7cb5eb2cae42 req-ad8fb61d-02ae-46d9-a391-d87e93be904f service nova] Creating event network-changed:e2c31a01-40a4-4b6e-aaee-cbeb1067272f for instance 502a82df-ee66-408d-ab9e-8207516c0415 on hv-cinder-78638 Apr 21 14:39:10.615800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-af6df301-a964-47e1-b3cf-7cb5eb2cae42 req-ad8fb61d-02ae-46d9-a391-d87e93be904f service nova] Acquired lock "compute-rpcapi-router" {{(pid=100563) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 21 14:39:10.620975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f591233-fb57-4722-9f95-aa29a0eeef29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:10.622321 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f591233-fb57-4722-9f95-aa29a0eeef29 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:10.632101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f591233-fb57-4722-9f95-aa29a0eeef29 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:10.633328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f591233-fb57-4722-9f95-aa29a0eeef29 None None] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:10.679836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.compute.rpcapi [None req-9f591233-fb57-4722-9f95-aa29a0eeef29 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 21 14:39:10.681979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f591233-fb57-4722-9f95-aa29a0eeef29 None None] Releasing lock "compute-rpcapi-router" {{(pid=100563) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 21 14:39:10.784348 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9f591233-fb57-4722-9f95-aa29a0eeef29 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.867509 Apr 21 14:39:10.785864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 26/43] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:39:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:39:10.800337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b6bd025e-ed9a-41eb-a186-905b72aeccce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:10.812506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b6bd025e-ed9a-41eb-a186-905b72aeccce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:10.848287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6bd025e-ed9a-41eb-a186-905b72aeccce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:10.849638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6bd025e-ed9a-41eb-a186-905b72aeccce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:10.851471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6bd025e-ed9a-41eb-a186-905b72aeccce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:10.852578 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6bd025e-ed9a-41eb-a186-905b72aeccce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:11.900755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:39:11.903490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:39:11.904890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:39:11.906083 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:39:11.907338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:39:11.929602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:11.931031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:11.933423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:11.934750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:11.981874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Getting quotas for project 71fbd46f910d42d1975f143a55e34822. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:39:11.993594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Getting quotas for user c17c00177d754342b2919b68a3f9df93 and project 71fbd46f910d42d1975f143a55e34822. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:39:12.010825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6bd025e-ed9a-41eb-a186-905b72aeccce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:12.058389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b6bd025e-ed9a-41eb-a186-905b72aeccce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 1.267692 Apr 21 14:39:12.062240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:39:12.063466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 27/44] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:10 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:12.080515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:39:12.091185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a6532eec-dc33-446e-b668-6fac8d19be57 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:12.108509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a6532eec-dc33-446e-b668-6fac8d19be57 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:12.143225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6532eec-dc33-446e-b668-6fac8d19be57 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:12.143736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6532eec-dc33-446e-b668-6fac8d19be57 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:12.144597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6532eec-dc33-446e-b668-6fac8d19be57 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:12.145116 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6532eec-dc33-446e-b668-6fac8d19be57 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:12.272131 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7f3ca368-98ed-4cc4-876a-ec01dc59e93b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.355855 Apr 21 14:39:12.291641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 18/45] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:39:03 2021] POST /compute/v2.1/servers => generated 383 bytes in 8377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:39:12.316659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f057e36e-b74b-4942-8b1c-fc67d7944f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:12.319292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f057e36e-b74b-4942-8b1c-fc67d7944f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:13.177266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f057e36e-b74b-4942-8b1c-fc67d7944f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:13.249570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f057e36e-b74b-4942-8b1c-fc67d7944f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1220 microversion: 2.1 time: 0.953681 Apr 21 14:39:13.263445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 19/46] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:12 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1220 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:13.307240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-79abcc3b-13b1-4248-8f42-d5f50bf57820 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:13.308974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-79abcc3b-13b1-4248-8f42-d5f50bf57820 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:13.329787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79abcc3b-13b1-4248-8f42-d5f50bf57820 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:13.331036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79abcc3b-13b1-4248-8f42-d5f50bf57820 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:13.332861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79abcc3b-13b1-4248-8f42-d5f50bf57820 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:13.334209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79abcc3b-13b1-4248-8f42-d5f50bf57820 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:13.521689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a6532eec-dc33-446e-b668-6fac8d19be57 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:13.537931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a6532eec-dc33-446e-b668-6fac8d19be57 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 1.472410 Apr 21 14:39:13.548805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 28/47] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:12 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:13.860275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1774504421", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bacac062-2ca2-4bed-9f00-1f32f650b8c7"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:14.200894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] validate_networks() for [('bacac062-2ca2-4bed-9f00-1f32f650b8c7', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:39:15.715781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79abcc3b-13b1-4248-8f42-d5f50bf57820 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:15.751752 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-79abcc3b-13b1-4248-8f42-d5f50bf57820 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 2.474106 Apr 21 14:39:15.753345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 20/48] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:13 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 2477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:15.772048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6dde516c-ec24-403c-97d3-8eea22372441 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:15.777601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6dde516c-ec24-403c-97d3-8eea22372441 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:15.814812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6dde516c-ec24-403c-97d3-8eea22372441 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:15.840569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6dde516c-ec24-403c-97d3-8eea22372441 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:15.842698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6dde516c-ec24-403c-97d3-8eea22372441 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:15.843784 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6dde516c-ec24-403c-97d3-8eea22372441 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:16.672344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6dde516c-ec24-403c-97d3-8eea22372441 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:16.693715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6dde516c-ec24-403c-97d3-8eea22372441 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 0.937287 Apr 21 14:39:16.695809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 21/49] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:15 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:16.788730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6bbe5a05-02fe-4dbe-b825-b22cf215553e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:16.793934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6bbe5a05-02fe-4dbe-b825-b22cf215553e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:16.832374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bbe5a05-02fe-4dbe-b825-b22cf215553e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:16.835526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bbe5a05-02fe-4dbe-b825-b22cf215553e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:16.851313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bbe5a05-02fe-4dbe-b825-b22cf215553e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:16.851821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bbe5a05-02fe-4dbe-b825-b22cf215553e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:17.589477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6bbe5a05-02fe-4dbe-b825-b22cf215553e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:17.607980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6bbe5a05-02fe-4dbe-b825-b22cf215553e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 0.825766 Apr 21 14:39:17.618851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 22/50] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:16 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:17.636355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-904068019", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4398a4b8-9ecd-43b2-988b-da3ccd660ad9"}], "security_groups": [{"name": "tempest-securitygroup--785079755"}], "key_name": "tempest-keypair-1218522724", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:18.386238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] validate_networks() for [('4398a4b8-9ecd-43b2-988b-da3ccd660ad9', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:39:19.124538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:39:19.125399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:39:19.130251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:39:19.131507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:39:19.134107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:39:19.171875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:19.172377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:19.173264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:19.173754 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:19.239809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Getting quotas for project 71fbd46f910d42d1975f143a55e34822. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:39:19.278033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Getting quotas for user c17c00177d754342b2919b68a3f9df93 and project 71fbd46f910d42d1975f143a55e34822. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:39:19.335709 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:39:19.356078 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:39:19.626597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ccbb213a-f242-40ca-887f-fcd405c6d242 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.774875 Apr 21 14:39:19.642424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 29/51] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:39:13 2021] POST /compute/v2.1/servers => generated 383 bytes in 5792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:39:19.664552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bb16ea98-d810-42b3-93ee-db106973bd18 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:19.667806 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bb16ea98-d810-42b3-93ee-db106973bd18 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:19.701668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb16ea98-d810-42b3-93ee-db106973bd18 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:19.702630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb16ea98-d810-42b3-93ee-db106973bd18 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:19.704221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb16ea98-d810-42b3-93ee-db106973bd18 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:19.705140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb16ea98-d810-42b3-93ee-db106973bd18 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:20.159392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:39:20.160263 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:39:20.161360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:39:20.162281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:39:20.163159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:39:20.196207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:20.198733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:20.200791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:20.201888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:20.247205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:39:20.256818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for user ff12725509264be384462a84ea6aaf64 and project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:39:20.289130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:39:20.292573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:39:20.369139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7d85e52b-d3ba-4646-9f03-9ad10ea902ea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.751261 Apr 21 14:39:20.402525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 23/52] 10.222.0.24 () {62 vars in 1178 bytes} [Wed Apr 21 14:39:17 2021] POST /compute/v2.1/servers => generated 401 bytes in 2786 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 21 14:39:20.688174 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-2cffda52-9554-41ae-927a-86e9e670b452 req-8997c1ce-f110-44fe-a62f-3e789a6ba298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9", "name": "network-vif-plugged", "status": "completed", "tag": "b0343fc5-ddf4-4954-92f9-5f7c45aaf301"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:20.690577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:39:20.690577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:39:20.713794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2cffda52-9554-41ae-927a-86e9e670b452 req-8997c1ce-f110-44fe-a62f-3e789a6ba298 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:20.714375 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2cffda52-9554-41ae-927a-86e9e670b452 req-8997c1ce-f110-44fe-a62f-3e789a6ba298 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:20.820624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-2cffda52-9554-41ae-927a-86e9e670b452 req-8997c1ce-f110-44fe-a62f-3e789a6ba298 service nova] Creating event network-vif-plugged:b0343fc5-ddf4-4954-92f9-5f7c45aaf301 for instance 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 on hv-cinder-78638 Apr 21 14:39:20.831358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-2cffda52-9554-41ae-927a-86e9e670b452 req-8997c1ce-f110-44fe-a62f-3e789a6ba298 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.426136 Apr 21 14:39:20.832730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 24/53] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:39:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:39:20.841829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ba5bf820-663b-4f24-9017-625c1a0f142a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:20.842956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ba5bf820-663b-4f24-9017-625c1a0f142a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:20.853669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba5bf820-663b-4f24-9017-625c1a0f142a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:20.867850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba5bf820-663b-4f24-9017-625c1a0f142a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:20.869943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba5bf820-663b-4f24-9017-625c1a0f142a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:20.871343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba5bf820-663b-4f24-9017-625c1a0f142a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:20.979166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bb16ea98-d810-42b3-93ee-db106973bd18 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:21.012332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bb16ea98-d810-42b3-93ee-db106973bd18 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 1.364677 Apr 21 14:39:21.014333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 30/54] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:19 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:21.036274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a7af4180-84df-4c82-8bf4-fc9bc839b863 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:21.038747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a7af4180-84df-4c82-8bf4-fc9bc839b863 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:21.074082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a7af4180-84df-4c82-8bf4-fc9bc839b863 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:21.075165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a7af4180-84df-4c82-8bf4-fc9bc839b863 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:21.076436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a7af4180-84df-4c82-8bf4-fc9bc839b863 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:21.080737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a7af4180-84df-4c82-8bf4-fc9bc839b863 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:21.615937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a7af4180-84df-4c82-8bf4-fc9bc839b863 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:21.630090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a7af4180-84df-4c82-8bf4-fc9bc839b863 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1274 microversion: 2.1 time: 0.613724 Apr 21 14:39:21.630747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 31/55] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:21 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1274 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:21.636833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:21.637750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:21.650051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:21.650843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:21.651849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:21.652658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:21.895948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:21.913120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:21.918118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:21.920114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-337193e6-e0bc-44f5-b948-9cb947e4dd25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1285 microversion: 2.20 time: 0.288071 Apr 21 14:39:21.933620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 32/56] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:21 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1285 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:22.032006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-27183570-6dd4-4efe-9684-05d4d050093d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:22.033165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-27183570-6dd4-4efe-9684-05d4d050093d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:22.044942 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27183570-6dd4-4efe-9684-05d4d050093d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:22.053503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27183570-6dd4-4efe-9684-05d4d050093d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:22.054735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27183570-6dd4-4efe-9684-05d4d050093d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:22.055416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27183570-6dd4-4efe-9684-05d4d050093d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:22.580636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ba5bf820-663b-4f24-9017-625c1a0f142a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:22.598073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ba5bf820-663b-4f24-9017-625c1a0f142a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 1.762871 Apr 21 14:39:22.603313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 25/57] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:20 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:22.671134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f4662890-ee45-4fd0-a560-2718ea2f37bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:22.673327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f4662890-ee45-4fd0-a560-2718ea2f37bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:22.679383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-27183570-6dd4-4efe-9684-05d4d050093d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:22.692826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-27183570-6dd4-4efe-9684-05d4d050093d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 0.664736 Apr 21 14:39:22.696357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 33/58] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:22 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:22.722994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4662890-ee45-4fd0-a560-2718ea2f37bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:22.724281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4662890-ee45-4fd0-a560-2718ea2f37bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:22.728670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4662890-ee45-4fd0-a560-2718ea2f37bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:22.732759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4662890-ee45-4fd0-a560-2718ea2f37bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:22.853573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-23c67a12-a8ef-4abf-8be1-91aceb1017c3 req-078b95eb-b184-4d29-b87a-ac08f360715c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502a82df-ee66-408d-ab9e-8207516c0415", "name": "network-vif-plugged", "status": "completed", "tag": "e2c31a01-40a4-4b6e-aaee-cbeb1067272f"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:22.856216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:39:22.856216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:39:22.876879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-23c67a12-a8ef-4abf-8be1-91aceb1017c3 req-078b95eb-b184-4d29-b87a-ac08f360715c service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:22.877766 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-23c67a12-a8ef-4abf-8be1-91aceb1017c3 req-078b95eb-b184-4d29-b87a-ac08f360715c service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:22.931871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-23c67a12-a8ef-4abf-8be1-91aceb1017c3 req-078b95eb-b184-4d29-b87a-ac08f360715c service nova] Creating event network-vif-plugged:e2c31a01-40a4-4b6e-aaee-cbeb1067272f for instance 502a82df-ee66-408d-ab9e-8207516c0415 on hv-cinder-78638 Apr 21 14:39:22.971532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-23c67a12-a8ef-4abf-8be1-91aceb1017c3 req-078b95eb-b184-4d29-b87a-ac08f360715c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114172 Apr 21 14:39:22.980737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 34/59] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:39:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:39:22.988303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:23.016584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:23.061184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:23.065689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:23.075190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:23.075873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:23.244345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f4662890-ee45-4fd0-a560-2718ea2f37bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:23.257100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f4662890-ee45-4fd0-a560-2718ea2f37bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1280 microversion: 2.1 time: 0.598491 Apr 21 14:39:23.264834 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 26/60] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:22 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1280 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:23.621883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-574e6743-11ec-4496-b4ff-4d1db0053e4f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:23.622908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-574e6743-11ec-4496-b4ff-4d1db0053e4f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:23.640495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-574e6743-11ec-4496-b4ff-4d1db0053e4f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:23.642448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-574e6743-11ec-4496-b4ff-4d1db0053e4f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:23.644213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-574e6743-11ec-4496-b4ff-4d1db0053e4f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:23.645169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-574e6743-11ec-4496-b4ff-4d1db0053e4f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:23.922440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:23.939542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:23.942991 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:23.947074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-49c97281-1fd9-438a-97b1-4b3da5d1afb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1341 microversion: 2.20 time: 0.963653 Apr 21 14:39:23.951362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 35/61] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:22 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1341 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:23.964924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-527471ac-eae4-4d8e-b59e-782c04c40c30 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:23.965862 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-527471ac-eae4-4d8e-b59e-782c04c40c30 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:23.986562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-527471ac-eae4-4d8e-b59e-782c04c40c30 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:23.987388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-527471ac-eae4-4d8e-b59e-782c04c40c30 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:23.991468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-527471ac-eae4-4d8e-b59e-782c04c40c30 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:23.992260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-527471ac-eae4-4d8e-b59e-782c04c40c30 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:24.614521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-574e6743-11ec-4496-b4ff-4d1db0053e4f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:24.627807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-574e6743-11ec-4496-b4ff-4d1db0053e4f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 1.011280 Apr 21 14:39:24.629748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 27/62] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:23 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:24.643828 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d64185f1-4e8b-4ef8-9084-14eb15ef4ce0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:24.645003 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d64185f1-4e8b-4ef8-9084-14eb15ef4ce0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:24.656094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d64185f1-4e8b-4ef8-9084-14eb15ef4ce0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:24.656957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d64185f1-4e8b-4ef8-9084-14eb15ef4ce0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:24.658705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d64185f1-4e8b-4ef8-9084-14eb15ef4ce0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:24.659425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d64185f1-4e8b-4ef8-9084-14eb15ef4ce0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:24.893638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d64185f1-4e8b-4ef8-9084-14eb15ef4ce0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:24.932324 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d64185f1-4e8b-4ef8-9084-14eb15ef4ce0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1280 microversion: 2.1 time: 0.301087 Apr 21 14:39:24.934606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 28/63] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:24 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:24.940251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6090d859-75b0-4535-aeb0-9eba9ea3098b req-b682113f-a2c3-409a-862e-de3ef609e4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7218e5c2-90e5-4d93-94d8-3ac413a54fbb", "tag": "789cafbf-6ab1-45fb-a401-fa6d24cd4994"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:24.954553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:39:24.954553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:39:24.978385 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6090d859-75b0-4535-aeb0-9eba9ea3098b req-b682113f-a2c3-409a-862e-de3ef609e4db service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:24.998878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6090d859-75b0-4535-aeb0-9eba9ea3098b req-b682113f-a2c3-409a-862e-de3ef609e4db service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:25.042338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-527471ac-eae4-4d8e-b59e-782c04c40c30 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:25.056901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6090d859-75b0-4535-aeb0-9eba9ea3098b req-b682113f-a2c3-409a-862e-de3ef609e4db service nova] Creating event network-changed:789cafbf-6ab1-45fb-a401-fa6d24cd4994 for instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb on hv-cinder-78638 Apr 21 14:39:25.062261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-527471ac-eae4-4d8e-b59e-782c04c40c30 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 1.109209 Apr 21 14:39:25.067011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 36/64] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:23 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:25.083936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6090d859-75b0-4535-aeb0-9eba9ea3098b req-b682113f-a2c3-409a-862e-de3ef609e4db service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147609 Apr 21 14:39:25.089956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:25.098953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 29/65] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:39:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:39:25.105665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:25.140587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:25.141517 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:25.143178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:25.154246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:25.379292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:25.410165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:25.415031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:25.417306 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bbcad622-bd44-4fdb-98f2-50270263043f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1339 microversion: 2.20 time: 0.348603 Apr 21 14:39:25.418513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 37/66] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:25 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1339 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:25.648551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b72bca53-9fd7-4d57-bb61-b62592bf9d0d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:25.649823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b72bca53-9fd7-4d57-bb61-b62592bf9d0d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:25.660439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b72bca53-9fd7-4d57-bb61-b62592bf9d0d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:25.661312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b72bca53-9fd7-4d57-bb61-b62592bf9d0d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:25.662518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b72bca53-9fd7-4d57-bb61-b62592bf9d0d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:25.663336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b72bca53-9fd7-4d57-bb61-b62592bf9d0d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:25.953184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-66b6e46e-c68d-4a95-a1bf-2249a9741dd0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:25.954076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-66b6e46e-c68d-4a95-a1bf-2249a9741dd0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:25.962702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66b6e46e-c68d-4a95-a1bf-2249a9741dd0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:25.963443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66b6e46e-c68d-4a95-a1bf-2249a9741dd0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:25.964648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66b6e46e-c68d-4a95-a1bf-2249a9741dd0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:25.965274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66b6e46e-c68d-4a95-a1bf-2249a9741dd0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:26.259551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-66b6e46e-c68d-4a95-a1bf-2249a9741dd0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:26.272501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-66b6e46e-c68d-4a95-a1bf-2249a9741dd0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.323241 Apr 21 14:39:26.273903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 38/67] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:25 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:26.280427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4452cdfb-3ded-4b79-ba71-05f644ed2009 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:26.281269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4452cdfb-3ded-4b79-ba71-05f644ed2009 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:26.292289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4452cdfb-3ded-4b79-ba71-05f644ed2009 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:26.293032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4452cdfb-3ded-4b79-ba71-05f644ed2009 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:26.294289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4452cdfb-3ded-4b79-ba71-05f644ed2009 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:26.294783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4452cdfb-3ded-4b79-ba71-05f644ed2009 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:26.397511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b72bca53-9fd7-4d57-bb61-b62592bf9d0d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:26.417152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b72bca53-9fd7-4d57-bb61-b62592bf9d0d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 0.773019 Apr 21 14:39:26.419893 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 30/68] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:25 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:26.441820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:26.443017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:26.455692 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:26.456318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:26.457151 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:26.458418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:26.559355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4452cdfb-3ded-4b79-ba71-05f644ed2009 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:26.568822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4452cdfb-3ded-4b79-ba71-05f644ed2009 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 0.293261 Apr 21 14:39:26.569618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 39/69] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:26 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:26.664497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:26.683333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:26.687492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:26.689821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d43b48da-17e6-49c4-97d3-a50334af8a9d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1339 microversion: 2.20 time: 0.253667 Apr 21 14:39:26.704792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 31/70] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:26 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1339 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:39:27.293589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4330c551-fd7e-4f67-98b8-17ad2bccbc74 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:27.294311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4330c551-fd7e-4f67-98b8-17ad2bccbc74 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:27.303168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4330c551-fd7e-4f67-98b8-17ad2bccbc74 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:27.303681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4330c551-fd7e-4f67-98b8-17ad2bccbc74 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:27.304524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4330c551-fd7e-4f67-98b8-17ad2bccbc74 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:27.305061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4330c551-fd7e-4f67-98b8-17ad2bccbc74 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:27.450524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d91ad4c4-d72d-47b8-bff2-42bc873dde4c tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:27.451538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d91ad4c4-d72d-47b8-bff2-42bc873dde4c tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:27.462276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d91ad4c4-d72d-47b8-bff2-42bc873dde4c tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:27.463309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d91ad4c4-d72d-47b8-bff2-42bc873dde4c tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:27.464337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d91ad4c4-d72d-47b8-bff2-42bc873dde4c tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:27.465002 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d91ad4c4-d72d-47b8-bff2-42bc873dde4c tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:28.109140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d91ad4c4-d72d-47b8-bff2-42bc873dde4c tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:28.127119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4330c551-fd7e-4f67-98b8-17ad2bccbc74 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:28.137339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d91ad4c4-d72d-47b8-bff2-42bc873dde4c tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 0.690919 Apr 21 14:39:28.143262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4330c551-fd7e-4f67-98b8-17ad2bccbc74 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.854742 Apr 21 14:39:28.144113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 40/71] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:27 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:28.145799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 32/72] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:27 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:28.163431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3e049adb-041e-4563-980f-900f1ff7dce3 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:28.165018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3e049adb-041e-4563-980f-900f1ff7dce3 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:28.170365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:28.171230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:28.182416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:28.183040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:28.184021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:28.184599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:28.188275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e049adb-041e-4563-980f-900f1ff7dce3 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:28.189896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e049adb-041e-4563-980f-900f1ff7dce3 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:28.192269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e049adb-041e-4563-980f-900f1ff7dce3 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:28.193589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e049adb-041e-4563-980f-900f1ff7dce3 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:28.666644 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:28.688143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:28.699799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:28.707521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ffe297d4-8149-41c9-9e99-5e7e66a9693a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1339 microversion: 2.20 time: 0.554076 Apr 21 14:39:28.712032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 41/73] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:28 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1339 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:29.173453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1d4f96c7-5728-4b4d-962a-81ef01f7f4cd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:29.174548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1d4f96c7-5728-4b4d-962a-81ef01f7f4cd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:29.191123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d4f96c7-5728-4b4d-962a-81ef01f7f4cd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:29.194660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d4f96c7-5728-4b4d-962a-81ef01f7f4cd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:29.195808 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d4f96c7-5728-4b4d-962a-81ef01f7f4cd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:29.198359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d4f96c7-5728-4b4d-962a-81ef01f7f4cd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:29.502925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3e049adb-041e-4563-980f-900f1ff7dce3 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:29.554276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3e049adb-041e-4563-980f-900f1ff7dce3 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1314 microversion: 2.1 time: 1.405967 Apr 21 14:39:29.555582 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 33/74] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:28 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1314 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:29.588797 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bdae6e9c-9858-40cf-9a16-4c38fae88149 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:29.590170 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bdae6e9c-9858-40cf-9a16-4c38fae88149 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:29.640318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdae6e9c-9858-40cf-9a16-4c38fae88149 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:29.641633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdae6e9c-9858-40cf-9a16-4c38fae88149 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:29.643033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdae6e9c-9858-40cf-9a16-4c38fae88149 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:29.651798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdae6e9c-9858-40cf-9a16-4c38fae88149 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:30.437197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1d4f96c7-5728-4b4d-962a-81ef01f7f4cd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:30.467606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1d4f96c7-5728-4b4d-962a-81ef01f7f4cd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1318 microversion: 2.1 time: 1.297950 Apr 21 14:39:30.469573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 42/75] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:29 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1318 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:30.482247 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:30.483868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:30.503540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:30.504855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:30.506966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:30.508183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:30.635020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bdae6e9c-9858-40cf-9a16-4c38fae88149 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:30.645215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bdae6e9c-9858-40cf-9a16-4c38fae88149 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 1.072292 Apr 21 14:39:30.646285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 34/76] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:29 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:30.659687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4a880126-32bb-4bc1-966e-6a374de1755e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:30.660668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4a880126-32bb-4bc1-966e-6a374de1755e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:30.669720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a880126-32bb-4bc1-966e-6a374de1755e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:30.670413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a880126-32bb-4bc1-966e-6a374de1755e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:30.671580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a880126-32bb-4bc1-966e-6a374de1755e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:30.672154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a880126-32bb-4bc1-966e-6a374de1755e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:31.091183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:31.108843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:31.120109 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:31.121485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a011a667-0fb0-4d32-ab93-b63f0ff34d78 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.649661 Apr 21 14:39:31.132379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 43/77] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:30 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:31.153867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-49a42879-d47c-46ed-9f5e-b2eb94634a6c req-31fe9da9-76dd-467d-a1f1-3c6255353284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95fa274-cc0e-4aee-bbc2-4a060be8e4b6", "tag": "658f52f1-b89f-4063-94df-1cdd4ca78f62"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:31.158557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:39:31.158557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:39:31.178652 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-49a42879-d47c-46ed-9f5e-b2eb94634a6c req-31fe9da9-76dd-467d-a1f1-3c6255353284 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:31.180553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-49a42879-d47c-46ed-9f5e-b2eb94634a6c req-31fe9da9-76dd-467d-a1f1-3c6255353284 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:31.222406 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-49a42879-d47c-46ed-9f5e-b2eb94634a6c req-31fe9da9-76dd-467d-a1f1-3c6255353284 service nova] Creating event network-changed:658f52f1-b89f-4063-94df-1cdd4ca78f62 for instance e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 on hv-cinder-78638 Apr 21 14:39:31.238069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-49a42879-d47c-46ed-9f5e-b2eb94634a6c req-31fe9da9-76dd-467d-a1f1-3c6255353284 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099631 Apr 21 14:39:31.240739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 44/78] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:39:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:39:31.297638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4a880126-32bb-4bc1-966e-6a374de1755e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:31.322485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4a880126-32bb-4bc1-966e-6a374de1755e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1501 microversion: 2.1 time: 0.673460 Apr 21 14:39:31.325420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 35/79] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:30 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1501 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:31.495802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-38dbd0f3-4890-4f61-aa2d-e3964bb24ae1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:31.519553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-38dbd0f3-4890-4f61-aa2d-e3964bb24ae1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:31.566787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38dbd0f3-4890-4f61-aa2d-e3964bb24ae1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:31.569522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38dbd0f3-4890-4f61-aa2d-e3964bb24ae1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:31.573720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38dbd0f3-4890-4f61-aa2d-e3964bb24ae1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:31.577505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38dbd0f3-4890-4f61-aa2d-e3964bb24ae1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:31.670703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4655cc95-e0b9-4c5e-b0d5-3044015681a9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:31.679305 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4655cc95-e0b9-4c5e-b0d5-3044015681a9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:31.731971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4655cc95-e0b9-4c5e-b0d5-3044015681a9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:31.732481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4655cc95-e0b9-4c5e-b0d5-3044015681a9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:31.733341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4655cc95-e0b9-4c5e-b0d5-3044015681a9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:31.733823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4655cc95-e0b9-4c5e-b0d5-3044015681a9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:32.147274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-38dbd0f3-4890-4f61-aa2d-e3964bb24ae1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:32.161622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-38dbd0f3-4890-4f61-aa2d-e3964bb24ae1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1509 microversion: 2.1 time: 0.676287 Apr 21 14:39:32.163540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 45/80] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:31 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1509 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:32.171208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:32.172851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:32.186781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:32.188282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:32.189570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:32.190320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:32.432659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4655cc95-e0b9-4c5e-b0d5-3044015681a9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:32.458672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4655cc95-e0b9-4c5e-b0d5-3044015681a9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.790172 Apr 21 14:39:32.460497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 36/81] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:31 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:32.474903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-b2baa381-2162-48dd-997f-d62d43604133 req-ab941c7e-a668-4387-928e-5b89170b07c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf3aa87-b02a-4b58-901a-76f4e825e75a", "tag": "245817c6-3c22-47d2-a7ad-82a9d1f0181d"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:32.476861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:39:32.476861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:39:32.525836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b2baa381-2162-48dd-997f-d62d43604133 req-ab941c7e-a668-4387-928e-5b89170b07c3 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:32.526448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b2baa381-2162-48dd-997f-d62d43604133 req-ab941c7e-a668-4387-928e-5b89170b07c3 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:32.592320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-b2baa381-2162-48dd-997f-d62d43604133 req-ab941c7e-a668-4387-928e-5b89170b07c3 service nova] Creating event network-changed:245817c6-3c22-47d2-a7ad-82a9d1f0181d for instance abf3aa87-b02a-4b58-901a-76f4e825e75a on hv-cinder-78638 Apr 21 14:39:32.599641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-b2baa381-2162-48dd-997f-d62d43604133 req-ab941c7e-a668-4387-928e-5b89170b07c3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137392 Apr 21 14:39:32.600379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 37/82] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:39:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:39:32.706717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:32.718805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:32.721578 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:32.723079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e54659c8-e43a-4389-82f0-87074e5c5980 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.558155 Apr 21 14:39:32.724898 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 46/83] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:32 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:33.483066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-734cd878-c429-4cf3-a49c-3337baaddbac tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:33.484168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-734cd878-c429-4cf3-a49c-3337baaddbac tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:33.516515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-734cd878-c429-4cf3-a49c-3337baaddbac tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:33.517477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-734cd878-c429-4cf3-a49c-3337baaddbac tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:33.519257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-734cd878-c429-4cf3-a49c-3337baaddbac tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:33.520447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-734cd878-c429-4cf3-a49c-3337baaddbac tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:33.763041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:33.764347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:33.784649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:33.785384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:33.786623 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:33.787380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:33.964614 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-734cd878-c429-4cf3-a49c-3337baaddbac tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:33.974822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-734cd878-c429-4cf3-a49c-3337baaddbac tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.499523 Apr 21 14:39:33.975717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 38/84] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:33 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:34.382077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:34.394362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:34.397360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:34.398872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-80337884-3ce9-42f6-b9be-a97d9878a83d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.644455 Apr 21 14:39:34.399689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 47/85] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:33 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:34.995545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1940f654-0fba-45ce-b5e3-29160bdc028e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:34.996313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1940f654-0fba-45ce-b5e3-29160bdc028e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:35.026173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1940f654-0fba-45ce-b5e3-29160bdc028e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:35.026747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1940f654-0fba-45ce-b5e3-29160bdc028e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:35.027661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1940f654-0fba-45ce-b5e3-29160bdc028e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:35.028160 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1940f654-0fba-45ce-b5e3-29160bdc028e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:35.425385 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:35.430086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:35.457227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:35.457566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:35.463914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:35.464467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:36.744258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1940f654-0fba-45ce-b5e3-29160bdc028e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:36.763265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1940f654-0fba-45ce-b5e3-29160bdc028e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 1.772527 Apr 21 14:39:36.764419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 39/86] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:34 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:37.025606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:37.061633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:37.069501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:37.078070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-86f05ddc-ffb1-46ff-b803-efe93eed4ec8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 1.655509 Apr 21 14:39:37.080797 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 48/87] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:35 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:39:37.422455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-09a5f0e9-e90a-4115-ad6f-6c97e7c0206e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c09879f-bbcb-4865-9f10-ef548c8f255e"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:37.426287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-09a5f0e9-e90a-4115-ad6f-6c97e7c0206e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:37.441038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-09a5f0e9-e90a-4115-ad6f-6c97e7c0206e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:37.442004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-09a5f0e9-e90a-4115-ad6f-6c97e7c0206e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:37.443203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-09a5f0e9-e90a-4115-ad6f-6c97e7c0206e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:37.456064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-09a5f0e9-e90a-4115-ad6f-6c97e7c0206e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:37.798674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-371c9013-8179-4ff8-b19b-aa88d5b1ab3e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:37.805420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-371c9013-8179-4ff8-b19b-aa88d5b1ab3e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:37.876091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-371c9013-8179-4ff8-b19b-aa88d5b1ab3e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:37.878253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-371c9013-8179-4ff8-b19b-aa88d5b1ab3e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:37.880825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-371c9013-8179-4ff8-b19b-aa88d5b1ab3e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:37.882105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-371c9013-8179-4ff8-b19b-aa88d5b1ab3e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:38.614827 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-09a5f0e9-e90a-4115-ad6f-6c97e7c0206e tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "POST /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.196770 Apr 21 14:39:38.616648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 40/88] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:39:37 2021] POST /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9/os-volume_attachments => generated 194 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:39:38.624673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d8986f93-a05e-49f2-bcdc-baa97cabcd78 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79de1dec-0f5f-475f-803d-7e45e4d3edfb"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:38.626763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d8986f93-a05e-49f2-bcdc-baa97cabcd78 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:38.639067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8986f93-a05e-49f2-bcdc-baa97cabcd78 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:38.639826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8986f93-a05e-49f2-bcdc-baa97cabcd78 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:38.641596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8986f93-a05e-49f2-bcdc-baa97cabcd78 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:38.642396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8986f93-a05e-49f2-bcdc-baa97cabcd78 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:39.108018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-371c9013-8179-4ff8-b19b-aa88d5b1ab3e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:39.132886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-371c9013-8179-4ff8-b19b-aa88d5b1ab3e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 1.343045 Apr 21 14:39:39.134804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 49/89] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:37 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:39.160565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:39.163733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:39.180268 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:39.181566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:39.183175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:39.184063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:40.023802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:40.079566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:40.081385 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:40.082861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f28abf44-47bd-4230-b941-17069f221727 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.946215 Apr 21 14:39:40.083463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 50/90] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:39 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:40.154701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-589e272a-7d15-419d-b790-8d56cea15b22 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:40.155522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-589e272a-7d15-419d-b790-8d56cea15b22 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:40.168795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-589e272a-7d15-419d-b790-8d56cea15b22 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:40.169925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-589e272a-7d15-419d-b790-8d56cea15b22 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:40.171608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-589e272a-7d15-419d-b790-8d56cea15b22 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:40.172651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-589e272a-7d15-419d-b790-8d56cea15b22 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:40.493580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d8986f93-a05e-49f2-bcdc-baa97cabcd78 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "POST /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.873951 Apr 21 14:39:40.494316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 41/91] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:39:38 2021] POST /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415/os-volume_attachments => generated 194 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:39:40.689744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-589e272a-7d15-419d-b790-8d56cea15b22 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:40.701362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-589e272a-7d15-419d-b790-8d56cea15b22 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.552145 Apr 21 14:39:40.702286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 51/92] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:40 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:39:41.103729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:41.104605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:41.114804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:41.115342 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:41.116278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:41.116770 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:41.482506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:41.500197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:41.503636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:41.506124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a6432e10-e1c8-4167-bb4a-c0f7d728f805 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.406799 Apr 21 14:39:41.507269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 42/93] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:41 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:41.721382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2951d3a1-8760-44ac-b609-64c18d9fe510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:41.722361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2951d3a1-8760-44ac-b609-64c18d9fe510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:41.732753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2951d3a1-8760-44ac-b609-64c18d9fe510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:41.733481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2951d3a1-8760-44ac-b609-64c18d9fe510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:41.734681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2951d3a1-8760-44ac-b609-64c18d9fe510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:41.735245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2951d3a1-8760-44ac-b609-64c18d9fe510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:42.150189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2951d3a1-8760-44ac-b609-64c18d9fe510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:42.166630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2951d3a1-8760-44ac-b609-64c18d9fe510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.449858 Apr 21 14:39:42.167963 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 52/94] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:41 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:42.544598 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:42.544598 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:42.553400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:42.554115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:42.555498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:42.555993 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:43.149502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:43.160541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:43.162336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:43.163635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2e6372b9-4d79-4552-b6a3-19d0a4297fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.630248 Apr 21 14:39:43.164259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 43/95] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:42 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:43.201505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-75d9848a-5606-4c70-be0e-f58b24d11bf3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:43.201505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-75d9848a-5606-4c70-be0e-f58b24d11bf3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:43.211296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75d9848a-5606-4c70-be0e-f58b24d11bf3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:43.211504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75d9848a-5606-4c70-be0e-f58b24d11bf3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:43.212700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75d9848a-5606-4c70-be0e-f58b24d11bf3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:43.213228 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75d9848a-5606-4c70-be0e-f58b24d11bf3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:43.513681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-75d9848a-5606-4c70-be0e-f58b24d11bf3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:43.528745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-75d9848a-5606-4c70-be0e-f58b24d11bf3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.340949 Apr 21 14:39:43.529562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 53/96] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:43 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:44.187025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:44.188255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:44.201883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:44.202737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:44.204165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:44.204961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:44.551557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6550c63a-8711-40cc-8d78-95383ac871bd tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:44.553055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6550c63a-8711-40cc-8d78-95383ac871bd tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:44.554520 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:44.567829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6550c63a-8711-40cc-8d78-95383ac871bd tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:44.568981 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6550c63a-8711-40cc-8d78-95383ac871bd tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:44.570384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6550c63a-8711-40cc-8d78-95383ac871bd tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:44.570984 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6550c63a-8711-40cc-8d78-95383ac871bd tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:44.573782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:44.577419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:44.583024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-47051b55-8afb-4bf2-8f1b-fa9c421002af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.401878 Apr 21 14:39:44.590128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 44/97] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:44 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:44.835077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6550c63a-8711-40cc-8d78-95383ac871bd tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:44.848312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6550c63a-8711-40cc-8d78-95383ac871bd tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.302283 Apr 21 14:39:44.849205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 54/98] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:44 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:39:45.615308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:45.616183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:45.627023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:45.627833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:45.628695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:45.629190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:45.868950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-333324fe-18a1-430d-ad33-88ad95134c32 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:45.869640 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-333324fe-18a1-430d-ad33-88ad95134c32 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:45.878729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-333324fe-18a1-430d-ad33-88ad95134c32 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:45.879289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-333324fe-18a1-430d-ad33-88ad95134c32 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:45.880165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-333324fe-18a1-430d-ad33-88ad95134c32 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:45.880666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-333324fe-18a1-430d-ad33-88ad95134c32 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:45.944195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:45.954382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:45.956069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:45.957296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e1550119-4d4a-4879-b317-899af43c4bbf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.347049 Apr 21 14:39:45.957956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 45/99] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:45 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:46.122178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-333324fe-18a1-430d-ad33-88ad95134c32 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:46.135058 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-333324fe-18a1-430d-ad33-88ad95134c32 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.270246 Apr 21 14:39:46.135925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 55/100] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:45 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:46.986069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:46.995989 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:47.012679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:47.013600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:47.014978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:47.016184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:47.158148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2d176e74-44e4-4cc9-9fc0-3e9e00c0d119 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:47.159713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2d176e74-44e4-4cc9-9fc0-3e9e00c0d119 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:47.180339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d176e74-44e4-4cc9-9fc0-3e9e00c0d119 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:47.181956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d176e74-44e4-4cc9-9fc0-3e9e00c0d119 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:47.184044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d176e74-44e4-4cc9-9fc0-3e9e00c0d119 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:47.184977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d176e74-44e4-4cc9-9fc0-3e9e00c0d119 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:47.394629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:47.405167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:47.407373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:47.408139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b011000d-d001-409a-97eb-c07f54e1f009 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.431249 Apr 21 14:39:47.408791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 46/101] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:46 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:47.497373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2d176e74-44e4-4cc9-9fc0-3e9e00c0d119 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:47.507855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2d176e74-44e4-4cc9-9fc0-3e9e00c0d119 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.358134 Apr 21 14:39:47.508509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 56/102] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:47 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:48.437328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:48.440415 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:48.464536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:48.465495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:48.466747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:48.468572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:48.533929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cac88afa-d62b-4b0d-a75c-d2439221928e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:48.535265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cac88afa-d62b-4b0d-a75c-d2439221928e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:48.578766 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cac88afa-d62b-4b0d-a75c-d2439221928e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:48.579549 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cac88afa-d62b-4b0d-a75c-d2439221928e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:48.580634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cac88afa-d62b-4b0d-a75c-d2439221928e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:48.581310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cac88afa-d62b-4b0d-a75c-d2439221928e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:48.793254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:48.807018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:48.809456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:48.810820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-23857713-390d-4a01-aa61-e400dabe83fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.386055 Apr 21 14:39:48.811559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 47/103] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:48 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:49.063398 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-bc279d18-aa9f-4005-9f20-f702356e7486 req-b8640d75-27d0-4b12-9a41-28cd3f087abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7218e5c2-90e5-4d93-94d8-3ac413a54fbb", "name": "network-vif-plugged", "status": "completed", "tag": "789cafbf-6ab1-45fb-a401-fa6d24cd4994"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:49.070375 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:39:49.070375 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:39:49.072992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cac88afa-d62b-4b0d-a75c-d2439221928e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:49.085476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cac88afa-d62b-4b0d-a75c-d2439221928e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.560074 Apr 21 14:39:49.092029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 57/104] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:48 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:49.106265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bc279d18-aa9f-4005-9f20-f702356e7486 req-b8640d75-27d0-4b12-9a41-28cd3f087abd service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:49.115675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bc279d18-aa9f-4005-9f20-f702356e7486 req-b8640d75-27d0-4b12-9a41-28cd3f087abd service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:49.191646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-bc279d18-aa9f-4005-9f20-f702356e7486 req-b8640d75-27d0-4b12-9a41-28cd3f087abd service nova] Creating event network-vif-plugged:789cafbf-6ab1-45fb-a401-fa6d24cd4994 for instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb on hv-cinder-78638 Apr 21 14:39:49.203854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-bc279d18-aa9f-4005-9f20-f702356e7486 req-b8640d75-27d0-4b12-9a41-28cd3f087abd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149401 Apr 21 14:39:49.207703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 48/105] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:39:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:39:49.853003 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:49.855192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:49.869970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:49.870628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:49.872729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:49.873538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:50.127075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c0e2082b-e3af-4712-8fe6-e2c4e345fa0f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:50.128370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c0e2082b-e3af-4712-8fe6-e2c4e345fa0f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:50.154840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0e2082b-e3af-4712-8fe6-e2c4e345fa0f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:50.155664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0e2082b-e3af-4712-8fe6-e2c4e345fa0f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:50.163343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0e2082b-e3af-4712-8fe6-e2c4e345fa0f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:50.163913 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0e2082b-e3af-4712-8fe6-e2c4e345fa0f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:50.324251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:50.348286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:50.359710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:50.362030 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7cc74066-9306-4220-8517-cdd55a252f4b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.516334 Apr 21 14:39:50.363627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 58/106] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:49 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:50.687587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c0e2082b-e3af-4712-8fe6-e2c4e345fa0f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:50.698950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c0e2082b-e3af-4712-8fe6-e2c4e345fa0f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.580402 Apr 21 14:39:50.699794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 49/107] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:50 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:51.391490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:51.393950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:51.405262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:51.405822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:51.407126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:51.407855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:51.731002 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c5baafce-4a56-4ee3-8a6d-26831d92b9e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:51.731844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c5baafce-4a56-4ee3-8a6d-26831d92b9e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:51.736155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:51.750292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c5baafce-4a56-4ee3-8a6d-26831d92b9e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:51.750292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c5baafce-4a56-4ee3-8a6d-26831d92b9e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:51.750292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c5baafce-4a56-4ee3-8a6d-26831d92b9e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:51.750292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c5baafce-4a56-4ee3-8a6d-26831d92b9e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:51.756060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:51.758275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:51.759959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f8039c7-77ac-41c3-9301-082d5664189f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.373663 Apr 21 14:39:51.760875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 59/108] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:51 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:51.999710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c5baafce-4a56-4ee3-8a6d-26831d92b9e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:52.018071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c5baafce-4a56-4ee3-8a6d-26831d92b9e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.293072 Apr 21 14:39:52.019247 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 50/109] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:51 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:52.780874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:52.781713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:52.791642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:52.792401 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:52.793439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:52.794152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:53.051780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f49ea4df-3374-47ce-8a95-6459baa250d6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:53.053704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f49ea4df-3374-47ce-8a95-6459baa250d6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:53.072103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f49ea4df-3374-47ce-8a95-6459baa250d6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:53.072991 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f49ea4df-3374-47ce-8a95-6459baa250d6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:53.074878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f49ea4df-3374-47ce-8a95-6459baa250d6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:53.075441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f49ea4df-3374-47ce-8a95-6459baa250d6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:53.078585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:53.095934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:53.099447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:53.101277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d23e6e08-d86e-4f40-87ac-8ac529722ec9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.324504 Apr 21 14:39:53.102397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 60/110] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:52 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:53.424008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f49ea4df-3374-47ce-8a95-6459baa250d6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:53.433894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f49ea4df-3374-47ce-8a95-6459baa250d6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.389840 Apr 21 14:39:53.434605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 51/111] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:53 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:54.132470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:54.133105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:54.142557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:54.143066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:54.143940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:54.144431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:54.385353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:54.396642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:54.398785 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:54.400342 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6f2c2fb7-b708-473d-ade5-0350cac39f8f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.272108 Apr 21 14:39:54.401175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 61/112] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:54 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:54.452812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-126a07a7-ceae-4b05-9a3a-a63e4357857d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:54.453481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-126a07a7-ceae-4b05-9a3a-a63e4357857d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:54.462241 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-126a07a7-ceae-4b05-9a3a-a63e4357857d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:54.462749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-126a07a7-ceae-4b05-9a3a-a63e4357857d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:54.463599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-126a07a7-ceae-4b05-9a3a-a63e4357857d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:54.464081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-126a07a7-ceae-4b05-9a3a-a63e4357857d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:54.711240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-126a07a7-ceae-4b05-9a3a-a63e4357857d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:54.721259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-126a07a7-ceae-4b05-9a3a-a63e4357857d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.272678 Apr 21 14:39:54.721906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 52/113] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:54 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:55.435386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:55.436566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:55.454659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:55.455898 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:55.457481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:55.458470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:55.743736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bda8445a-6be5-4a90-9e6e-e61a69f91c71 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:55.744566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bda8445a-6be5-4a90-9e6e-e61a69f91c71 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:55.754673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bda8445a-6be5-4a90-9e6e-e61a69f91c71 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:55.755278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bda8445a-6be5-4a90-9e6e-e61a69f91c71 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:55.756352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bda8445a-6be5-4a90-9e6e-e61a69f91c71 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:55.757011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bda8445a-6be5-4a90-9e6e-e61a69f91c71 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:55.798511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:55.810228 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:55.812254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:55.813476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-44dd0f6f-4ae6-4617-ad82-9cce45058885 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.385935 Apr 21 14:39:55.814144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 62/114] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:55 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:56.011567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bda8445a-6be5-4a90-9e6e-e61a69f91c71 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:56.028817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bda8445a-6be5-4a90-9e6e-e61a69f91c71 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.291210 Apr 21 14:39:56.030296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 53/115] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:55 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:56.834326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:56.835509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:56.845811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:56.846572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:56.847575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:56.848201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:57.058821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e557d093-cac2-4953-b724-57d7d96f22db tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:57.060424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e557d093-cac2-4953-b724-57d7d96f22db tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:57.077132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e557d093-cac2-4953-b724-57d7d96f22db tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:57.077949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e557d093-cac2-4953-b724-57d7d96f22db tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:57.079703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e557d093-cac2-4953-b724-57d7d96f22db tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:57.081018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e557d093-cac2-4953-b724-57d7d96f22db tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:57.116726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:57.138937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:57.142832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:57.145294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e2968639-f647-4b87-831f-d59065ffc193 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.315648 Apr 21 14:39:57.159218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 63/116] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:56 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:57.445853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e557d093-cac2-4953-b724-57d7d96f22db tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:57.457024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e557d093-cac2-4953-b724-57d7d96f22db tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.406565 Apr 21 14:39:57.457662 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 54/117] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:57 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:58.178849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:58.179714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:58.189095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:58.189639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:58.190534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:58.191028 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:58.481437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb2ae079-8931-4f3b-b123-9874c78e328e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:58.486676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb2ae079-8931-4f3b-b123-9874c78e328e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:58.523699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb2ae079-8931-4f3b-b123-9874c78e328e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:58.524290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb2ae079-8931-4f3b-b123-9874c78e328e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:58.531858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb2ae079-8931-4f3b-b123-9874c78e328e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:58.532493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb2ae079-8931-4f3b-b123-9874c78e328e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:58.594211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:58.616842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:58.621971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:58.624901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-53aee48f-acf4-47b0-bd06-5737e1f15619 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.450704 Apr 21 14:39:58.626609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 64/118] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:58 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:39:58.769302 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-e3d600be-8cce-485d-bae2-7f0c06afd064 req-51514163-1a11-4385-b5a4-98b4cfab2e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf3aa87-b02a-4b58-901a-76f4e825e75a", "name": "network-vif-plugged", "status": "completed", "tag": "245817c6-3c22-47d2-a7ad-82a9d1f0181d"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:39:58.773281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:39:58.773281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:39:58.792592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e3d600be-8cce-485d-bae2-7f0c06afd064 req-51514163-1a11-4385-b5a4-98b4cfab2e6f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:58.793563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e3d600be-8cce-485d-bae2-7f0c06afd064 req-51514163-1a11-4385-b5a4-98b4cfab2e6f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:58.834589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-e3d600be-8cce-485d-bae2-7f0c06afd064 req-51514163-1a11-4385-b5a4-98b4cfab2e6f service nova] Creating event network-vif-plugged:245817c6-3c22-47d2-a7ad-82a9d1f0181d for instance abf3aa87-b02a-4b58-901a-76f4e825e75a on hv-cinder-78638 Apr 21 14:39:58.861807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-e3d600be-8cce-485d-bae2-7f0c06afd064 req-51514163-1a11-4385-b5a4-98b4cfab2e6f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097229 Apr 21 14:39:58.862859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 65/119] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:39:59.058403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eb2ae079-8931-4f3b-b123-9874c78e328e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:39:59.072114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb2ae079-8931-4f3b-b123-9874c78e328e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.599819 Apr 21 14:39:59.079022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 55/120] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:39:58 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:39:59.660053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:39:59.661383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:39:59.679381 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:59.680603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:39:59.682119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:39:59.682933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:00.025299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dc6daf6b-3adb-463b-bf50-b690740e9562 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:00.026735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dc6daf6b-3adb-463b-bf50-b690740e9562 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:00.058424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc6daf6b-3adb-463b-bf50-b690740e9562 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:00.059068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc6daf6b-3adb-463b-bf50-b690740e9562 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:00.060528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc6daf6b-3adb-463b-bf50-b690740e9562 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:00.061541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc6daf6b-3adb-463b-bf50-b690740e9562 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:00.072291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:00.108328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:00.110344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:00.112066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-84984a52-cd65-4470-8ffc-87f8715da87e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.460463 Apr 21 14:40:00.112917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 66/121] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:39:59 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:40:00.120848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b8901fa7-cab0-4afb-ba4f-aaa6c1a27aab tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:00.121760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b8901fa7-cab0-4afb-ba4f-aaa6c1a27aab tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:00.131312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8901fa7-cab0-4afb-ba4f-aaa6c1a27aab tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:00.132332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8901fa7-cab0-4afb-ba4f-aaa6c1a27aab tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:00.133708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8901fa7-cab0-4afb-ba4f-aaa6c1a27aab tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:00.134404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8901fa7-cab0-4afb-ba4f-aaa6c1a27aab tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:00.217148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dc6daf6b-3adb-463b-bf50-b690740e9562 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:40:00.375032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dc6daf6b-3adb-463b-bf50-b690740e9562 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 204 len: 0 microversion: 2.1 time: 0.356012 Apr 21 14:40:00.376681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 56/122] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:40:00 2021] DELETE /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 21 14:40:00.391888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d02dfda7-2d5d-4423-876c-10de395e2e7a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:00.394055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d02dfda7-2d5d-4423-876c-10de395e2e7a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:00.421380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d02dfda7-2d5d-4423-876c-10de395e2e7a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:00.422199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d02dfda7-2d5d-4423-876c-10de395e2e7a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:00.424176 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d02dfda7-2d5d-4423-876c-10de395e2e7a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:00.425402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d02dfda7-2d5d-4423-876c-10de395e2e7a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:00.655408 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b8901fa7-cab0-4afb-ba4f-aaa6c1a27aab tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:00.667451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b8901fa7-cab0-4afb-ba4f-aaa6c1a27aab tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.552821 Apr 21 14:40:00.669571 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 67/123] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:00 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:00.781921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d02dfda7-2d5d-4423-876c-10de395e2e7a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:00.793390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d02dfda7-2d5d-4423-876c-10de395e2e7a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1553 microversion: 2.1 time: 0.409703 Apr 21 14:40:00.794440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 57/124] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:00 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1553 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:00.964971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a2f3e51e-5975-496d-a6de-c5782a815c3c req-6f6045b9-7953-40f6-95d2-e6a1a9b1d3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95fa274-cc0e-4aee-bbc2-4a060be8e4b6", "name": "network-vif-plugged", "status": "completed", "tag": "658f52f1-b89f-4063-94df-1cdd4ca78f62"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:00.968746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:40:00.968746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:40:01.004937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a2f3e51e-5975-496d-a6de-c5782a815c3c req-6f6045b9-7953-40f6-95d2-e6a1a9b1d3dc service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:01.006268 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a2f3e51e-5975-496d-a6de-c5782a815c3c req-6f6045b9-7953-40f6-95d2-e6a1a9b1d3dc service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:01.068556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a2f3e51e-5975-496d-a6de-c5782a815c3c req-6f6045b9-7953-40f6-95d2-e6a1a9b1d3dc service nova] Creating event network-vif-plugged:658f52f1-b89f-4063-94df-1cdd4ca78f62 for instance e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 on hv-cinder-78638 Apr 21 14:40:01.081211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a2f3e51e-5975-496d-a6de-c5782a815c3c req-6f6045b9-7953-40f6-95d2-e6a1a9b1d3dc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125376 Apr 21 14:40:01.082844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 68/125] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:40:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:01.140629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:01.143733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:01.161678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:01.182860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:01.185601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:01.188761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:01.465745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:01.476131 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:01.477897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:01.479735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c16b1d1-00ad-42ec-b731-0d153afbae37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.349518 Apr 21 14:40:01.479735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 58/126] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:40:01 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:40:01.699134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8996e5d0-16ea-4f54-a844-ccdeaa5cabb7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:01.700022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8996e5d0-16ea-4f54-a844-ccdeaa5cabb7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:01.709004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8996e5d0-16ea-4f54-a844-ccdeaa5cabb7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:01.709520 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8996e5d0-16ea-4f54-a844-ccdeaa5cabb7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:01.710419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8996e5d0-16ea-4f54-a844-ccdeaa5cabb7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:01.710909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8996e5d0-16ea-4f54-a844-ccdeaa5cabb7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:01.813434 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-957ae9bd-c976-44bf-b04d-d5a44403409a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:01.814287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-957ae9bd-c976-44bf-b04d-d5a44403409a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:01.823301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-957ae9bd-c976-44bf-b04d-d5a44403409a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:01.823810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-957ae9bd-c976-44bf-b04d-d5a44403409a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:01.824728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-957ae9bd-c976-44bf-b04d-d5a44403409a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:01.825220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-957ae9bd-c976-44bf-b04d-d5a44403409a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:02.043311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8996e5d0-16ea-4f54-a844-ccdeaa5cabb7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:02.053612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8996e5d0-16ea-4f54-a844-ccdeaa5cabb7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.360536 Apr 21 14:40:02.054439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 69/127] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:01 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:02.089114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-957ae9bd-c976-44bf-b04d-d5a44403409a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:02.107243 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-957ae9bd-c976-44bf-b04d-d5a44403409a tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1553 microversion: 2.1 time: 0.297658 Apr 21 14:40:02.108453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 59/128] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:01 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1553 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:02.507122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:02.507781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:02.516728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:02.517220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:02.518117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:02.518604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:02.807596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:02.818667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:02.820365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:02.821655 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7093093f-ec2f-4c85-a4ca-9daa39017b7e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.318947 Apr 21 14:40:02.822326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 70/129] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:40:02 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:40:03.073063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dea4d493-d2eb-4495-bdb6-e59cea2de399 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:03.073777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dea4d493-d2eb-4495-bdb6-e59cea2de399 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:03.082159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dea4d493-d2eb-4495-bdb6-e59cea2de399 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:03.082666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dea4d493-d2eb-4495-bdb6-e59cea2de399 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:03.083514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dea4d493-d2eb-4495-bdb6-e59cea2de399 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:03.083996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dea4d493-d2eb-4495-bdb6-e59cea2de399 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:03.135517 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-afd9aaeb-dfaf-4465-9fc1-993214e08641 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:03.136456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-afd9aaeb-dfaf-4465-9fc1-993214e08641 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:03.146322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afd9aaeb-dfaf-4465-9fc1-993214e08641 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:03.147044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afd9aaeb-dfaf-4465-9fc1-993214e08641 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:03.148276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afd9aaeb-dfaf-4465-9fc1-993214e08641 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:03.149080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afd9aaeb-dfaf-4465-9fc1-993214e08641 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:03.384469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dea4d493-d2eb-4495-bdb6-e59cea2de399 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:03.402960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dea4d493-d2eb-4495-bdb6-e59cea2de399 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.333636 Apr 21 14:40:03.404332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 60/130] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:03 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:03.421096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-afd9aaeb-dfaf-4465-9fc1-993214e08641 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:03.442383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-afd9aaeb-dfaf-4465-9fc1-993214e08641 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1553 microversion: 2.1 time: 0.310780 Apr 21 14:40:03.443405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 71/131] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:03 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1553 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:03.843338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:03.844477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:03.862097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:03.863498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:03.865108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:03.866057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:04.183521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:04.194736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:04.196679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:04.197838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ca7a5e60-74b0-4cb2-a966-dbbf8c0c8e69 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.360535 Apr 21 14:40:04.198491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 61/132] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:40:03 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:40:04.432314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d46d4d41-e8de-4934-b073-e1a3402fdc4d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:04.433029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d46d4d41-e8de-4934-b073-e1a3402fdc4d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:04.442196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d46d4d41-e8de-4934-b073-e1a3402fdc4d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:04.442706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d46d4d41-e8de-4934-b073-e1a3402fdc4d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:04.443595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d46d4d41-e8de-4934-b073-e1a3402fdc4d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:04.444086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d46d4d41-e8de-4934-b073-e1a3402fdc4d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:04.470590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5dafa0cf-598d-486f-883e-c211ab30a732 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:04.471540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5dafa0cf-598d-486f-883e-c211ab30a732 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:04.481108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5dafa0cf-598d-486f-883e-c211ab30a732 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:04.481889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5dafa0cf-598d-486f-883e-c211ab30a732 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:04.482919 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5dafa0cf-598d-486f-883e-c211ab30a732 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:04.483469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5dafa0cf-598d-486f-883e-c211ab30a732 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:04.704620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d46d4d41-e8de-4934-b073-e1a3402fdc4d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:04.720056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d46d4d41-e8de-4934-b073-e1a3402fdc4d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.291930 Apr 21 14:40:04.721024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 72/133] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:04 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:04.807144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5dafa0cf-598d-486f-883e-c211ab30a732 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:04.818279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5dafa0cf-598d-486f-883e-c211ab30a732 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1553 microversion: 2.1 time: 0.351902 Apr 21 14:40:04.818961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 62/134] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:04 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1553 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:05.217744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:05.218452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:05.227582 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:05.228088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:05.228951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:05.229441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:05.498432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:05.509480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:05.511207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:05.512472 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9632522b-3fab-4747-8ad2-39f9a22e2125 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.299211 Apr 21 14:40:05.513130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 73/135] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:40:05 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:40:05.743566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fa9abe56-2963-40d6-b551-b73da556d0dc tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:05.744440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fa9abe56-2963-40d6-b551-b73da556d0dc tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:05.755968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa9abe56-2963-40d6-b551-b73da556d0dc tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:05.756740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa9abe56-2963-40d6-b551-b73da556d0dc tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:05.757602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa9abe56-2963-40d6-b551-b73da556d0dc tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:05.758227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa9abe56-2963-40d6-b551-b73da556d0dc tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:05.841334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5b764234-55f7-4aee-9623-a0abda530bb8 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:05.842412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5b764234-55f7-4aee-9623-a0abda530bb8 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:05.856071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b764234-55f7-4aee-9623-a0abda530bb8 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:05.856945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b764234-55f7-4aee-9623-a0abda530bb8 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:05.858482 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b764234-55f7-4aee-9623-a0abda530bb8 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:05.859338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b764234-55f7-4aee-9623-a0abda530bb8 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:06.093510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fa9abe56-2963-40d6-b551-b73da556d0dc tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:06.112407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fa9abe56-2963-40d6-b551-b73da556d0dc tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.374757 Apr 21 14:40:06.113446 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 63/136] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:05 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:06.194757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5b764234-55f7-4aee-9623-a0abda530bb8 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:06.211198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5b764234-55f7-4aee-9623-a0abda530bb8 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1553 microversion: 2.1 time: 0.376245 Apr 21 14:40:06.212197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 74/137] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:05 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1553 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:06.535469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:06.536046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:06.544922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:06.545453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:06.546338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:06.546825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:06.844609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:06.869025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:06.872974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:06.875747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ca2e7a96-9e2f-4ebd-8e27-b4b4ee3f76e0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1406 microversion: 2.20 time: 0.344252 Apr 21 14:40:06.878022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 64/138] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:40:06 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:40:07.134391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-13204cba-e366-474c-9d02-fea6b35e8346 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:07.135064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-13204cba-e366-474c-9d02-fea6b35e8346 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:07.143739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13204cba-e366-474c-9d02-fea6b35e8346 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:07.144252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13204cba-e366-474c-9d02-fea6b35e8346 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:07.145107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13204cba-e366-474c-9d02-fea6b35e8346 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:07.145602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13204cba-e366-474c-9d02-fea6b35e8346 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:07.230498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e419246d-ec19-4ca2-b1ce-a0b97223af84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:07.231205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e419246d-ec19-4ca2-b1ce-a0b97223af84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:07.239974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e419246d-ec19-4ca2-b1ce-a0b97223af84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:07.240485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e419246d-ec19-4ca2-b1ce-a0b97223af84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:07.241326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e419246d-ec19-4ca2-b1ce-a0b97223af84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:07.241831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e419246d-ec19-4ca2-b1ce-a0b97223af84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:07.455178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-13204cba-e366-474c-9d02-fea6b35e8346 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:07.465248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-13204cba-e366-474c-9d02-fea6b35e8346 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.335004 Apr 21 14:40:07.465916 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 75/139] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:07 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:07.552284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e419246d-ec19-4ca2-b1ce-a0b97223af84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:07.565265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e419246d-ec19-4ca2-b1ce-a0b97223af84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1553 microversion: 2.1 time: 0.338948 Apr 21 14:40:07.565908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 65/140] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:07 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:07.897235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:07.897912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:07.906964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:07.907477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:07.908396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:07.908895 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:08.246248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:08.263763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:08.267740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:08.270224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-174a259d-733d-4055-9b6d-a1db6158424b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1598 microversion: 2.20 time: 0.377004 Apr 21 14:40:08.271732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 76/141] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:40:07 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1598 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:40:08.291440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cfe4d382-8642-4e64-bc0e-dec2b8abc67f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:08.292012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cfe4d382-8642-4e64-bc0e-dec2b8abc67f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:08.301229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cfe4d382-8642-4e64-bc0e-dec2b8abc67f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:08.301664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cfe4d382-8642-4e64-bc0e-dec2b8abc67f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:08.302610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cfe4d382-8642-4e64-bc0e-dec2b8abc67f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:08.303111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cfe4d382-8642-4e64-bc0e-dec2b8abc67f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:08.490954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cfe4d382-8642-4e64-bc0e-dec2b8abc67f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.203374 Apr 21 14:40:08.492249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 66/142] 10.222.0.24 () {60 vars in 1306 bytes} [Wed Apr 21 14:40:08 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:40:08.495359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0ec4e370-3bfd-4268-9a7a-3d5885f885de tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:08.496420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0ec4e370-3bfd-4268-9a7a-3d5885f885de tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:08.526039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ec4e370-3bfd-4268-9a7a-3d5885f885de tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:08.526350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ec4e370-3bfd-4268-9a7a-3d5885f885de tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:08.528151 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ec4e370-3bfd-4268-9a7a-3d5885f885de tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:08.528492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ec4e370-3bfd-4268-9a7a-3d5885f885de tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:08.594753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a0a4ead-bf9d-4566-a8ae-cd4fc2a9e852 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:08.597097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a0a4ead-bf9d-4566-a8ae-cd4fc2a9e852 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:08.619548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a0a4ead-bf9d-4566-a8ae-cd4fc2a9e852 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:08.620946 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a0a4ead-bf9d-4566-a8ae-cd4fc2a9e852 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:08.624748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a0a4ead-bf9d-4566-a8ae-cd4fc2a9e852 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:08.626822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a0a4ead-bf9d-4566-a8ae-cd4fc2a9e852 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:08.995233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3a0a4ead-bf9d-4566-a8ae-cd4fc2a9e852 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:09.035184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a0a4ead-bf9d-4566-a8ae-cd4fc2a9e852 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1553 microversion: 2.1 time: 0.450532 Apr 21 14:40:09.036865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 67/143] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:08 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1553 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:09.197382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0ec4e370-3bfd-4268-9a7a-3d5885f885de tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:09.211703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0ec4e370-3bfd-4268-9a7a-3d5885f885de tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1322 microversion: 2.1 time: 0.722712 Apr 21 14:40:09.212873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 77/144] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:08 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1322 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:09.500677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1760620183", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "networks": [{"uuid": "d7586439-5692-45b4-a121-4de98b0d3272"}]}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:09.690565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] validate_networks() for [('d7586439-5692-45b4-a121-4de98b0d3272', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:40:10.069920 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fc6f0cf4-c7da-42d8-9450-c5196fe62b33 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:10.076085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fc6f0cf4-c7da-42d8-9450-c5196fe62b33 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:10.108994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc6f0cf4-c7da-42d8-9450-c5196fe62b33 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:10.119396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc6f0cf4-c7da-42d8-9450-c5196fe62b33 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:10.121694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc6f0cf4-c7da-42d8-9450-c5196fe62b33 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:10.122990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc6f0cf4-c7da-42d8-9450-c5196fe62b33 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:10.949759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:40:10.951924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:40:10.953311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:40:10.954491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:40:10.958540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:40:10.985267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:10.988218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:10.990685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:10.992185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:11.065329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Getting quotas for project c273beec5c4c4f89a4c7c896497de7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:40:11.078468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Getting quotas for user fc4c490791d14d0981977c2544a8f9c5 and project c273beec5c4c4f89a4c7c896497de7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:40:11.116921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:40:11.124074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:40:11.243281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fc6f0cf4-c7da-42d8-9450-c5196fe62b33 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:11.263853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fc6f0cf4-c7da-42d8-9450-c5196fe62b33 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1553 microversion: 2.1 time: 1.202297 Apr 21 14:40:11.271967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-68028516-5038-437d-908c-70c05df2c3a3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779450 Apr 21 14:40:11.273762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 78/145] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:10 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1553 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:11.274154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 68/146] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:40:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:40:11.295980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e601e77f-c95a-4524-b501-d65a8f495460 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:11.300351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e601e77f-c95a-4524-b501-d65a8f495460 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:11.302015 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a153ee22-2c42-4404-9ed0-5e62281c323a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:11.303327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a153ee22-2c42-4404-9ed0-5e62281c323a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:11.333695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e601e77f-c95a-4524-b501-d65a8f495460 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:11.340979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e601e77f-c95a-4524-b501-d65a8f495460 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:11.342642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e601e77f-c95a-4524-b501-d65a8f495460 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:11.343594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e601e77f-c95a-4524-b501-d65a8f495460 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:11.542983 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a153ee22-2c42-4404-9ed0-5e62281c323a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:11.553607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a153ee22-2c42-4404-9ed0-5e62281c323a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1218 microversion: 2.1 time: 0.269444 Apr 21 14:40:11.555289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 69/147] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:11 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1218 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:12.292786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e287a51b-5a64-4276-ba9e-cd8523b1a052 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:12.294985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e287a51b-5a64-4276-ba9e-cd8523b1a052 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:12.305422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e287a51b-5a64-4276-ba9e-cd8523b1a052 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:12.306399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e287a51b-5a64-4276-ba9e-cd8523b1a052 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:12.307640 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e287a51b-5a64-4276-ba9e-cd8523b1a052 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:12.308386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e287a51b-5a64-4276-ba9e-cd8523b1a052 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:12.681926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e287a51b-5a64-4276-ba9e-cd8523b1a052 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:12.695824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e287a51b-5a64-4276-ba9e-cd8523b1a052 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1553 microversion: 2.1 time: 0.406181 Apr 21 14:40:12.696809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 70/148] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:12 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1553 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:12.704601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f3a66c0f-277f-4f4f-904f-a9ca4c32fc12 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:12.705913 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f3a66c0f-277f-4f4f-904f-a9ca4c32fc12 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:12.724856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3a66c0f-277f-4f4f-904f-a9ca4c32fc12 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:12.725677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3a66c0f-277f-4f4f-904f-a9ca4c32fc12 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:12.727531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3a66c0f-277f-4f4f-904f-a9ca4c32fc12 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:12.728270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3a66c0f-277f-4f4f-904f-a9ca4c32fc12 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:12.760782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e601e77f-c95a-4524-b501-d65a8f495460 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:12.778980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e601e77f-c95a-4524-b501-d65a8f495460 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1517 microversion: 2.1 time: 1.494864 Apr 21 14:40:12.779938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 79/149] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:11 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1517 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:12.804068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-965b8ed7-b371-4e3e-ad6b-b9eea88a5510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:12.805339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-965b8ed7-b371-4e3e-ad6b-b9eea88a5510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:12.820364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-965b8ed7-b371-4e3e-ad6b-b9eea88a5510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:12.820978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-965b8ed7-b371-4e3e-ad6b-b9eea88a5510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:12.827253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-965b8ed7-b371-4e3e-ad6b-b9eea88a5510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:12.827768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-965b8ed7-b371-4e3e-ad6b-b9eea88a5510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:12.953443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-965b8ed7-b371-4e3e-ad6b-b9eea88a5510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lazy-loading 'flavor' on Instance uuid e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:40:13.045014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f3a66c0f-277f-4f4f-904f-a9ca4c32fc12 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:13.055025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f3a66c0f-277f-4f4f-904f-a9ca4c32fc12 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1214 microversion: 2.1 time: 0.356096 Apr 21 14:40:13.055703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 71/150] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:12 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1214 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:13.084514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f58ffde6-3beb-409e-ac11-92a026bdb643 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:13.086379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f58ffde6-3beb-409e-ac11-92a026bdb643 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:13.108630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f58ffde6-3beb-409e-ac11-92a026bdb643 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:13.113538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f58ffde6-3beb-409e-ac11-92a026bdb643 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:13.121294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f58ffde6-3beb-409e-ac11-92a026bdb643 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:13.122653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f58ffde6-3beb-409e-ac11-92a026bdb643 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:13.271614 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-965b8ed7-b371-4e3e-ad6b-b9eea88a5510 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "POST /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6/action" status: 200 len: 32 microversion: 2.1 time: 0.471251 Apr 21 14:40:13.276553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 80/151] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:40:12 2021] POST /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6/action => generated 32 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 21 14:40:13.286931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-0172a8c7-4474-4b9d-a7e5-cba363e8d1e8 req-9b6d9f38-064b-4b16-ac54-b6406ded1bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf3aa87-b02a-4b58-901a-76f4e825e75a", "tag": "245817c6-3c22-47d2-a7ad-82a9d1f0181d"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:13.290236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:40:13.290236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:40:13.305533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0172a8c7-4474-4b9d-a7e5-cba363e8d1e8 req-9b6d9f38-064b-4b16-ac54-b6406ded1bc0 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:13.306164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0172a8c7-4474-4b9d-a7e5-cba363e8d1e8 req-9b6d9f38-064b-4b16-ac54-b6406ded1bc0 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:13.325261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-0172a8c7-4474-4b9d-a7e5-cba363e8d1e8 req-9b6d9f38-064b-4b16-ac54-b6406ded1bc0 service nova] Creating event network-changed:245817c6-3c22-47d2-a7ad-82a9d1f0181d for instance abf3aa87-b02a-4b58-901a-76f4e825e75a on hv-cinder-78638 Apr 21 14:40:13.333344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-0172a8c7-4474-4b9d-a7e5-cba363e8d1e8 req-9b6d9f38-064b-4b16-ac54-b6406ded1bc0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057342 Apr 21 14:40:13.334777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 81/152] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:40:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:13.346507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cea9c18c-6f77-4053-af43-2dabee3dde1a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:13.347999 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cea9c18c-6f77-4053-af43-2dabee3dde1a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:13.365906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cea9c18c-6f77-4053-af43-2dabee3dde1a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:13.367095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cea9c18c-6f77-4053-af43-2dabee3dde1a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:13.368822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cea9c18c-6f77-4053-af43-2dabee3dde1a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:13.370029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cea9c18c-6f77-4053-af43-2dabee3dde1a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:13.690114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cea9c18c-6f77-4053-af43-2dabee3dde1a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:13.705617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cea9c18c-6f77-4053-af43-2dabee3dde1a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.368448 Apr 21 14:40:13.707029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 82/153] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:13 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:13.737055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ce85a0c4-35db-4e00-b09e-f926f089549c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:13.738413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ce85a0c4-35db-4e00-b09e-f926f089549c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:13.755382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce85a0c4-35db-4e00-b09e-f926f089549c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:13.756226 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce85a0c4-35db-4e00-b09e-f926f089549c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:13.757802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce85a0c4-35db-4e00-b09e-f926f089549c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:13.758978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce85a0c4-35db-4e00-b09e-f926f089549c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:13.967278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ce85a0c4-35db-4e00-b09e-f926f089549c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:13.981442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ce85a0c4-35db-4e00-b09e-f926f089549c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1511 microversion: 2.1 time: 0.256828 Apr 21 14:40:13.982738 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 83/154] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:13 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:14.074417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-51c44f7e-7f88-445f-960e-2ad1b9b14427 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:14.075128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-51c44f7e-7f88-445f-960e-2ad1b9b14427 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:14.084551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51c44f7e-7f88-445f-960e-2ad1b9b14427 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:14.085065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51c44f7e-7f88-445f-960e-2ad1b9b14427 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:14.086064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51c44f7e-7f88-445f-960e-2ad1b9b14427 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:14.086635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51c44f7e-7f88-445f-960e-2ad1b9b14427 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:14.236702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-51c44f7e-7f88-445f-960e-2ad1b9b14427 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:14.255889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-51c44f7e-7f88-445f-960e-2ad1b9b14427 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1214 microversion: 2.1 time: 0.185925 Apr 21 14:40:14.257297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 84/155] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:14 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:14.737720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-53cae6f4-f07a-4b05-acbe-7f71a33dfff0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:14.738508 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-53cae6f4-f07a-4b05-acbe-7f71a33dfff0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:14.747986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53cae6f4-f07a-4b05-acbe-7f71a33dfff0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:14.748619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53cae6f4-f07a-4b05-acbe-7f71a33dfff0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:14.749479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53cae6f4-f07a-4b05-acbe-7f71a33dfff0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:14.749973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53cae6f4-f07a-4b05-acbe-7f71a33dfff0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:15.001684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-53cae6f4-f07a-4b05-acbe-7f71a33dfff0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:15.017843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-53cae6f4-f07a-4b05-acbe-7f71a33dfff0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.284539 Apr 21 14:40:15.019191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 85/156] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:14 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:15.025464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8bf857ea-31a3-44d5-8900-8f56929b6a84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:15.026470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8bf857ea-31a3-44d5-8900-8f56929b6a84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:15.055085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bf857ea-31a3-44d5-8900-8f56929b6a84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:15.055889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bf857ea-31a3-44d5-8900-8f56929b6a84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:15.056987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bf857ea-31a3-44d5-8900-8f56929b6a84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:15.057922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bf857ea-31a3-44d5-8900-8f56929b6a84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:15.194977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bf857ea-31a3-44d5-8900-8f56929b6a84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:15.205784 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8bf857ea-31a3-44d5-8900-8f56929b6a84 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1511 microversion: 2.1 time: 0.185158 Apr 21 14:40:15.206460 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 86/157] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:15 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:15.285216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-41fb90d7-7a51-442d-8212-47ecaca055ee tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:15.285905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-41fb90d7-7a51-442d-8212-47ecaca055ee tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:15.294873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41fb90d7-7a51-442d-8212-47ecaca055ee tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:15.295388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41fb90d7-7a51-442d-8212-47ecaca055ee tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:15.296237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41fb90d7-7a51-442d-8212-47ecaca055ee tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:15.296751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41fb90d7-7a51-442d-8212-47ecaca055ee tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:15.440355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-41fb90d7-7a51-442d-8212-47ecaca055ee tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:15.453749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-41fb90d7-7a51-442d-8212-47ecaca055ee tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1214 microversion: 2.1 time: 0.172975 Apr 21 14:40:15.454437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 87/158] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:15 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:15.459600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-3df121e3-c513-484a-ab2b-055b4f46d207 req-8d9783e7-a332-4ed0-94dc-c3e7484bbbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9", "name": "network-vif-deleted", "tag": "b0343fc5-ddf4-4954-92f9-5f7c45aaf301"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:15.461496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:40:15.461496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:40:15.471286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-3df121e3-c513-484a-ab2b-055b4f46d207 req-8d9783e7-a332-4ed0-94dc-c3e7484bbbd1 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:15.471783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-3df121e3-c513-484a-ab2b-055b4f46d207 req-8d9783e7-a332-4ed0-94dc-c3e7484bbbd1 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:15.491312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-3df121e3-c513-484a-ab2b-055b4f46d207 req-8d9783e7-a332-4ed0-94dc-c3e7484bbbd1 service nova] Creating event network-vif-deleted:b0343fc5-ddf4-4954-92f9-5f7c45aaf301 for instance 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 on hv-cinder-78638 Apr 21 14:40:15.496980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-3df121e3-c513-484a-ab2b-055b4f46d207 req-8d9783e7-a332-4ed0-94dc-c3e7484bbbd1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041118 Apr 21 14:40:15.497636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 88/159] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:40:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:16.039775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-169a7067-a033-4e96-bb1b-fab469aea2a0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:16.040677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-169a7067-a033-4e96-bb1b-fab469aea2a0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:16.050843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-169a7067-a033-4e96-bb1b-fab469aea2a0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:16.051388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-169a7067-a033-4e96-bb1b-fab469aea2a0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:16.052283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-169a7067-a033-4e96-bb1b-fab469aea2a0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:16.052787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-169a7067-a033-4e96-bb1b-fab469aea2a0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:16.292928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-169a7067-a033-4e96-bb1b-fab469aea2a0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:16.303059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-169a7067-a033-4e96-bb1b-fab469aea2a0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.268816 Apr 21 14:40:16.303723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 89/160] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:16 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:16.308934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3ffe38d1-2e5d-4d58-a9a8-67b398e912d9 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:16.309606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3ffe38d1-2e5d-4d58-a9a8-67b398e912d9 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:16.318422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ffe38d1-2e5d-4d58-a9a8-67b398e912d9 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:16.318928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ffe38d1-2e5d-4d58-a9a8-67b398e912d9 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:16.319783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ffe38d1-2e5d-4d58-a9a8-67b398e912d9 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:16.320274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ffe38d1-2e5d-4d58-a9a8-67b398e912d9 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:16.501470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3ffe38d1-2e5d-4d58-a9a8-67b398e912d9 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:16.512177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3ffe38d1-2e5d-4d58-a9a8-67b398e912d9 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1511 microversion: 2.1 time: 0.207280 Apr 21 14:40:16.512834 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 90/161] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:16 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:16.517777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f1dabd2-4cd7-427a-ac3a-b13c10a90231 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:16.518494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f1dabd2-4cd7-427a-ac3a-b13c10a90231 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:16.527130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f1dabd2-4cd7-427a-ac3a-b13c10a90231 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:16.527627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f1dabd2-4cd7-427a-ac3a-b13c10a90231 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:16.528460 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f1dabd2-4cd7-427a-ac3a-b13c10a90231 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:16.528938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f1dabd2-4cd7-427a-ac3a-b13c10a90231 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:16.658919 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3f1dabd2-4cd7-427a-ac3a-b13c10a90231 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:16.669385 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f1dabd2-4cd7-427a-ac3a-b13c10a90231 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1214 microversion: 2.1 time: 0.155376 Apr 21 14:40:16.670126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 91/162] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:16 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:17.333352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-993c6afb-159d-4851-816d-abad128e3891 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:17.334104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-993c6afb-159d-4851-816d-abad128e3891 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:17.344772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-993c6afb-159d-4851-816d-abad128e3891 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:17.345370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-993c6afb-159d-4851-816d-abad128e3891 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:17.346417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-993c6afb-159d-4851-816d-abad128e3891 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:17.346969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-993c6afb-159d-4851-816d-abad128e3891 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:17.608701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f58ffde6-3beb-409e-ac11-92a026bdb643 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 14 microversion: 2.20 time: 4.528528 Apr 21 14:40:17.609585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 72/163] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:13 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 14 bytes in 4531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:17.621727 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d8fd564a-8d7e-4f9f-8969-3348be42cc36 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:17.623253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d8fd564a-8d7e-4f9f-8969-3348be42cc36 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:17.643721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8fd564a-8d7e-4f9f-8969-3348be42cc36 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:17.646215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8fd564a-8d7e-4f9f-8969-3348be42cc36 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:17.648310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8fd564a-8d7e-4f9f-8969-3348be42cc36 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:17.652837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8fd564a-8d7e-4f9f-8969-3348be42cc36 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:17.839993 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d8fd564a-8d7e-4f9f-8969-3348be42cc36 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:17.850777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d8fd564a-8d7e-4f9f-8969-3348be42cc36 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1345 microversion: 2.1 time: 0.239604 Apr 21 14:40:17.851667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 73/164] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:17 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1345 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:17.857127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-313afc8f-8198-4f0d-a423-bcac51e6f262 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:17.857792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-313afc8f-8198-4f0d-a423-bcac51e6f262 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:17.866363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-313afc8f-8198-4f0d-a423-bcac51e6f262 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:17.866866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-313afc8f-8198-4f0d-a423-bcac51e6f262 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:17.867792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-313afc8f-8198-4f0d-a423-bcac51e6f262 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:17.868273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-313afc8f-8198-4f0d-a423-bcac51e6f262 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:17.954626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-993c6afb-159d-4851-816d-abad128e3891 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:17.983284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-993c6afb-159d-4851-816d-abad128e3891 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.651638 Apr 21 14:40:17.984174 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 92/165] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:17 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:18.089658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-313afc8f-8198-4f0d-a423-bcac51e6f262 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:18.108115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-313afc8f-8198-4f0d-a423-bcac51e6f262 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1270 microversion: 2.1 time: 0.254708 Apr 21 14:40:18.109339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 74/166] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:17 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1270 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:18.638133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9981f5e4-8214-4230-b146-e8c91e2eca90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:18.647496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9981f5e4-8214-4230-b146-e8c91e2eca90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:18.666606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9981f5e4-8214-4230-b146-e8c91e2eca90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:18.667474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9981f5e4-8214-4230-b146-e8c91e2eca90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:18.668618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9981f5e4-8214-4230-b146-e8c91e2eca90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:18.671184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9981f5e4-8214-4230-b146-e8c91e2eca90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:18.874479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6e9d47fe-c389-4237-b68b-ddeb952d6857 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:18.877346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6e9d47fe-c389-4237-b68b-ddeb952d6857 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:18.927874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e9d47fe-c389-4237-b68b-ddeb952d6857 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:18.928493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e9d47fe-c389-4237-b68b-ddeb952d6857 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:18.937422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e9d47fe-c389-4237-b68b-ddeb952d6857 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:18.938341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e9d47fe-c389-4237-b68b-ddeb952d6857 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:18.996759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9981f5e4-8214-4230-b146-e8c91e2eca90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 14 microversion: 2.20 time: 0.374339 Apr 21 14:40:18.999656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 93/167] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:18 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 14 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:19.035250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-20abd308-7f06-48b3-b9eb-4439043f7733 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:19.037089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-20abd308-7f06-48b3-b9eb-4439043f7733 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:19.081677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20abd308-7f06-48b3-b9eb-4439043f7733 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:19.082703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20abd308-7f06-48b3-b9eb-4439043f7733 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:19.084270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20abd308-7f06-48b3-b9eb-4439043f7733 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:19.085213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20abd308-7f06-48b3-b9eb-4439043f7733 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:19.442348 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6e9d47fe-c389-4237-b68b-ddeb952d6857 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c90025246146098edf50012bef2ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedd46ed5a7b480b96fc0f889ee9392f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:19.454254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6e9d47fe-c389-4237-b68b-ddeb952d6857 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 200 len: 1345 microversion: 2.1 time: 0.587482 Apr 21 14:40:19.454912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 75/168] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:18 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 1345 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:19.470514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f823fec-6f27-47f4-8196-cef77f6a6e31 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:19.471184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f823fec-6f27-47f4-8196-cef77f6a6e31 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:19.491277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f823fec-6f27-47f4-8196-cef77f6a6e31 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:19.496963 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f823fec-6f27-47f4-8196-cef77f6a6e31 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:19.497972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f823fec-6f27-47f4-8196-cef77f6a6e31 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:19.498517 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f823fec-6f27-47f4-8196-cef77f6a6e31 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:19.900271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-20abd308-7f06-48b3-b9eb-4439043f7733 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:19.915461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-20abd308-7f06-48b3-b9eb-4439043f7733 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.905203 Apr 21 14:40:19.922050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 94/169] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:19 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:20.013636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5298b25c-39e2-4422-b081-159838da2088 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:20.014739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5298b25c-39e2-4422-b081-159838da2088 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:20.044798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f823fec-6f27-47f4-8196-cef77f6a6e31 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:20.050003 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5298b25c-39e2-4422-b081-159838da2088 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:20.050952 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5298b25c-39e2-4422-b081-159838da2088 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:20.052024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5298b25c-39e2-4422-b081-159838da2088 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:20.052546 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5298b25c-39e2-4422-b081-159838da2088 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:20.073557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f823fec-6f27-47f4-8196-cef77f6a6e31 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1276 microversion: 2.1 time: 0.606597 Apr 21 14:40:20.074717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 76/170] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:19 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1276 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:20.355532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5298b25c-39e2-4422-b081-159838da2088 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 4298 microversion: 2.20 time: 0.345751 Apr 21 14:40:20.357765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 95/171] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:20 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 4298 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:40:20.505100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72135cc9-bae0-4713-a067-a5d1a8cfd144 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:20.510446 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-72135cc9-bae0-4713-a067-a5d1a8cfd144 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:20.586713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72135cc9-bae0-4713-a067-a5d1a8cfd144 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:20.596016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72135cc9-bae0-4713-a067-a5d1a8cfd144 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:20.608765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72135cc9-bae0-4713-a067-a5d1a8cfd144 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:20.610416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72135cc9-bae0-4713-a067-a5d1a8cfd144 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:20.899484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-72135cc9-bae0-4713-a067-a5d1a8cfd144 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] HTTP exception thrown: Instance 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 could not be found. Apr 21 14:40:20.900928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72135cc9-bae0-4713-a067-a5d1a8cfd144 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Returning 404 to user: Instance 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:40:20.902506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-72135cc9-bae0-4713-a067-a5d1a8cfd144 tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 404 len: 111 microversion: 2.1 time: 0.412876 Apr 21 14:40:20.903782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 77/172] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:20 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 111 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:40:20.950845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bf54c9b0-2230-4617-b8ce-8d8da0325966 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:20.953451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bf54c9b0-2230-4617-b8ce-8d8da0325966 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:21.035178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf54c9b0-2230-4617-b8ce-8d8da0325966 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:21.036617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf54c9b0-2230-4617-b8ce-8d8da0325966 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:21.044026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf54c9b0-2230-4617-b8ce-8d8da0325966 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:21.046538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf54c9b0-2230-4617-b8ce-8d8da0325966 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:21.116521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8ccd051c-bbdd-4c1e-83f8-e819823106ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:21.124062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8ccd051c-bbdd-4c1e-83f8-e819823106ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:21.169532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ccd051c-bbdd-4c1e-83f8-e819823106ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:21.178390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ccd051c-bbdd-4c1e-83f8-e819823106ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:21.179481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ccd051c-bbdd-4c1e-83f8-e819823106ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:21.180292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ccd051c-bbdd-4c1e-83f8-e819823106ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:21.883625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bf54c9b0-2230-4617-b8ce-8d8da0325966 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:21.897865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bf54c9b0-2230-4617-b8ce-8d8da0325966 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.956686 Apr 21 14:40:21.910428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 96/173] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:20 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:21.920684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-35d0e140-7ec2-480c-9c81-d35b25d8d426 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:21.920684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-35d0e140-7ec2-480c-9c81-d35b25d8d426 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:21.931372 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35d0e140-7ec2-480c-9c81-d35b25d8d426 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:21.931959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35d0e140-7ec2-480c-9c81-d35b25d8d426 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:21.932967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35d0e140-7ec2-480c-9c81-d35b25d8d426 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:21.933258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35d0e140-7ec2-480c-9c81-d35b25d8d426 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:22.167242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-35d0e140-7ec2-480c-9c81-d35b25d8d426 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 15025 microversion: 2.20 time: 0.244014 Apr 21 14:40:22.167242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 97/174] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:21 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 15025 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:22.677359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8ccd051c-bbdd-4c1e-83f8-e819823106ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:22.686796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8ccd051c-bbdd-4c1e-83f8-e819823106ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1318 microversion: 2.1 time: 1.597080 Apr 21 14:40:22.687455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 78/175] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:21 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1318 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:22.926618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-23252bc5-43f4-43cc-ba54-685d1bba4caa tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:22.927693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-23252bc5-43f4-43cc-ba54-685d1bba4caa tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:22.947585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23252bc5-43f4-43cc-ba54-685d1bba4caa tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:22.952340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23252bc5-43f4-43cc-ba54-685d1bba4caa tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:22.953495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23252bc5-43f4-43cc-ba54-685d1bba4caa tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:22.956168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23252bc5-43f4-43cc-ba54-685d1bba4caa tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:23.185356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-386eef77-7799-45a0-8a3c-aab421f58b58 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:23.186514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-386eef77-7799-45a0-8a3c-aab421f58b58 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:23.201659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-386eef77-7799-45a0-8a3c-aab421f58b58 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:23.202224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-386eef77-7799-45a0-8a3c-aab421f58b58 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:23.203108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-386eef77-7799-45a0-8a3c-aab421f58b58 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:23.203611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-386eef77-7799-45a0-8a3c-aab421f58b58 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:23.444624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-386eef77-7799-45a0-8a3c-aab421f58b58 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 17960 microversion: 2.20 time: 0.263033 Apr 21 14:40:23.451774 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 79/176] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:23 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 17960 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:40:23.459127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-879bedec-2c87-420a-8f74-bf31aa277a2d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:23.462032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-879bedec-2c87-420a-8f74-bf31aa277a2d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:23.487087 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-879bedec-2c87-420a-8f74-bf31aa277a2d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:23.490885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-879bedec-2c87-420a-8f74-bf31aa277a2d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:23.494761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-879bedec-2c87-420a-8f74-bf31aa277a2d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:23.495373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-879bedec-2c87-420a-8f74-bf31aa277a2d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:23.623863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-23252bc5-43f4-43cc-ba54-685d1bba4caa tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:23.638945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-23252bc5-43f4-43cc-ba54-685d1bba4caa tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.717752 Apr 21 14:40:23.639596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 98/177] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:22 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:23.641697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-879bedec-2c87-420a-8f74-bf31aa277a2d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] HTTP exception thrown: Instance 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 could not be found. Apr 21 14:40:23.642682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-879bedec-2c87-420a-8f74-bf31aa277a2d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Returning 404 to user: Instance 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:40:23.643842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-879bedec-2c87-420a-8f74-bf31aa277a2d tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 404 len: 111 microversion: 2.1 time: 0.196205 Apr 21 14:40:23.644701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 80/178] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:40:23 2021] DELETE /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:40:23.654512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-84de0df5-591e-4676-a711-967f28a08758 req-1c591cb3-539b-4945-b94e-9cc56be0c740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7219388-ce17-45a3-b762-ddb8f62f57d4", "tag": "c8eaff5b-4a42-4389-bc4b-1592ce5859e2"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:23.664084 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:40:23.664084 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:40:23.669929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07a9f49b-b69a-4e90-8a2f-b953de93bd3c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:23.670885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-07a9f49b-b69a-4e90-8a2f-b953de93bd3c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] [instance: 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:23.682521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-84de0df5-591e-4676-a711-967f28a08758 req-1c591cb3-539b-4945-b94e-9cc56be0c740 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:23.683339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-84de0df5-591e-4676-a711-967f28a08758 req-1c591cb3-539b-4945-b94e-9cc56be0c740 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:23.687127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a9f49b-b69a-4e90-8a2f-b953de93bd3c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:23.688307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a9f49b-b69a-4e90-8a2f-b953de93bd3c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:23.689411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a9f49b-b69a-4e90-8a2f-b953de93bd3c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:23.690162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a9f49b-b69a-4e90-8a2f-b953de93bd3c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:23.729843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-84de0df5-591e-4676-a711-967f28a08758 req-1c591cb3-539b-4945-b94e-9cc56be0c740 service nova] Creating event network-changed:c8eaff5b-4a42-4389-bc4b-1592ce5859e2 for instance d7219388-ce17-45a3-b762-ddb8f62f57d4 on hv-cinder-78638 Apr 21 14:40:23.745122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-84de0df5-591e-4676-a711-967f28a08758 req-1c591cb3-539b-4945-b94e-9cc56be0c740 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101702 Apr 21 14:40:23.749389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 99/179] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:40:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:23.759698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-03c6717b-e7db-4192-9bfb-a3370ab9568a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:23.764162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-03c6717b-e7db-4192-9bfb-a3370ab9568a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:23.767140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-07a9f49b-b69a-4e90-8a2f-b953de93bd3c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] HTTP exception thrown: Instance 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 could not be found. Apr 21 14:40:23.768690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07a9f49b-b69a-4e90-8a2f-b953de93bd3c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] Returning 404 to user: Instance 7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:40:23.770173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-07a9f49b-b69a-4e90-8a2f-b953de93bd3c tempest-DeleteServersTestJSON-1007340987 tempest-DeleteServersTestJSON-1007340987-project] 10.222.0.24 "GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9" status: 404 len: 111 microversion: 2.1 time: 0.113530 Apr 21 14:40:23.771793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 81/180] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:23 2021] GET /compute/v2.1/servers/7a034ea5-e8bd-41b9-8fa8-ccdb0dd683d9 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:40:23.785158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03c6717b-e7db-4192-9bfb-a3370ab9568a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:23.791628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03c6717b-e7db-4192-9bfb-a3370ab9568a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:23.792693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03c6717b-e7db-4192-9bfb-a3370ab9568a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:23.793210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03c6717b-e7db-4192-9bfb-a3370ab9568a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:24.461938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2508ba88-d940-4ca2-9a2e-fa7343e663de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:24.463137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2508ba88-d940-4ca2-9a2e-fa7343e663de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:24.472356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2508ba88-d940-4ca2-9a2e-fa7343e663de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:24.473168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2508ba88-d940-4ca2-9a2e-fa7343e663de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:24.474419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2508ba88-d940-4ca2-9a2e-fa7343e663de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:24.475399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2508ba88-d940-4ca2-9a2e-fa7343e663de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:24.537040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-03c6717b-e7db-4192-9bfb-a3370ab9568a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:24.565314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-03c6717b-e7db-4192-9bfb-a3370ab9568a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1318 microversion: 2.1 time: 0.813792 Apr 21 14:40:24.567576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 100/181] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:23 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:24.594432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2508ba88-d940-4ca2-9a2e-fa7343e663de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 18561 microversion: 2.20 time: 0.136656 Apr 21 14:40:24.595927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 82/182] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:24 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 18561 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:24.661569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-49f41930-010a-4005-939b-1567dd09ca15 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:24.663258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-49f41930-010a-4005-939b-1567dd09ca15 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:24.682506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49f41930-010a-4005-939b-1567dd09ca15 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:24.684067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49f41930-010a-4005-939b-1567dd09ca15 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:24.686048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49f41930-010a-4005-939b-1567dd09ca15 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:24.687196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49f41930-010a-4005-939b-1567dd09ca15 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:25.519941 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-49f41930-010a-4005-939b-1567dd09ca15 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:25.533940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-49f41930-010a-4005-939b-1567dd09ca15 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.879885 Apr 21 14:40:25.535249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 101/183] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:24 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:25.585835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c649ab7-81ac-4bca-a633-4ea4aaaccd3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:25.587069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5c649ab7-81ac-4bca-a633-4ea4aaaccd3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:25.602380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c649ab7-81ac-4bca-a633-4ea4aaaccd3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:25.609735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aca0b724-4de9-4ffb-a38d-730104ddb680 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:25.612022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aca0b724-4de9-4ffb-a38d-730104ddb680 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:25.615464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c649ab7-81ac-4bca-a633-4ea4aaaccd3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:25.616940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c649ab7-81ac-4bca-a633-4ea4aaaccd3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:25.620125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c649ab7-81ac-4bca-a633-4ea4aaaccd3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:25.634478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aca0b724-4de9-4ffb-a38d-730104ddb680 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:25.635363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aca0b724-4de9-4ffb-a38d-730104ddb680 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:25.636427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aca0b724-4de9-4ffb-a38d-730104ddb680 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:25.637104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aca0b724-4de9-4ffb-a38d-730104ddb680 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:25.847906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aca0b724-4de9-4ffb-a38d-730104ddb680 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 20991 microversion: 2.20 time: 0.242472 Apr 21 14:40:25.849020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 102/184] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:25 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 20991 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:26.512466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c649ab7-81ac-4bca-a633-4ea4aaaccd3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:26.534156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5c649ab7-81ac-4bca-a633-4ea4aaaccd3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1318 microversion: 2.1 time: 0.951295 Apr 21 14:40:26.536996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 83/185] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:25 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1318 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:26.567802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-46aa3583-153a-4788-991d-4538a912e24c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:26.569262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-46aa3583-153a-4788-991d-4538a912e24c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:26.610903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46aa3583-153a-4788-991d-4538a912e24c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:26.611865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46aa3583-153a-4788-991d-4538a912e24c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:26.613478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46aa3583-153a-4788-991d-4538a912e24c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:26.614444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46aa3583-153a-4788-991d-4538a912e24c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:26.865679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-62431e5e-b3a2-4b72-a141-8e991f58434a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:26.868300 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-62431e5e-b3a2-4b72-a141-8e991f58434a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:26.886086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62431e5e-b3a2-4b72-a141-8e991f58434a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:26.887361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62431e5e-b3a2-4b72-a141-8e991f58434a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:26.889035 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62431e5e-b3a2-4b72-a141-8e991f58434a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:26.889936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62431e5e-b3a2-4b72-a141-8e991f58434a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:27.018587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-46aa3583-153a-4788-991d-4538a912e24c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:27.037415 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-46aa3583-153a-4788-991d-4538a912e24c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.478710 Apr 21 14:40:27.038813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 103/186] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:26 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:27.072975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-62431e5e-b3a2-4b72-a141-8e991f58434a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 22710 microversion: 2.20 time: 0.215091 Apr 21 14:40:27.074798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 84/187] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:26 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 22710 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:27.574378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c6095f0e-4c67-406e-9053-400899ec0bea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:27.577066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c6095f0e-4c67-406e-9053-400899ec0bea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:27.615943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6095f0e-4c67-406e-9053-400899ec0bea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:27.619145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6095f0e-4c67-406e-9053-400899ec0bea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:27.624338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6095f0e-4c67-406e-9053-400899ec0bea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:27.626621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6095f0e-4c67-406e-9053-400899ec0bea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:28.068951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-75b51cc5-41ac-4cda-a1eb-2057d8c69f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:28.070653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-75b51cc5-41ac-4cda-a1eb-2057d8c69f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:28.115291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75b51cc5-41ac-4cda-a1eb-2057d8c69f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:28.116271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75b51cc5-41ac-4cda-a1eb-2057d8c69f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:28.117937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75b51cc5-41ac-4cda-a1eb-2057d8c69f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:28.119994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75b51cc5-41ac-4cda-a1eb-2057d8c69f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:28.879990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-75b51cc5-41ac-4cda-a1eb-2057d8c69f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:28.907597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-75b51cc5-41ac-4cda-a1eb-2057d8c69f19 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.852332 Apr 21 14:40:28.921286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 85/188] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:28 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:28.936014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-624b949e-3c2e-4a51-b69f-67b521191aa4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:28.938380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-624b949e-3c2e-4a51-b69f-67b521191aa4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:28.952162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-624b949e-3c2e-4a51-b69f-67b521191aa4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:28.952624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-624b949e-3c2e-4a51-b69f-67b521191aa4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:28.953757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-624b949e-3c2e-4a51-b69f-67b521191aa4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:28.954494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-624b949e-3c2e-4a51-b69f-67b521191aa4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:29.106116 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-624b949e-3c2e-4a51-b69f-67b521191aa4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 25209 microversion: 2.20 time: 0.180683 Apr 21 14:40:29.112275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 86/189] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:28 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 25209 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:29.124020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c6095f0e-4c67-406e-9053-400899ec0bea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:29.138676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c6095f0e-4c67-406e-9053-400899ec0bea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1318 microversion: 2.1 time: 1.576984 Apr 21 14:40:29.150238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 104/190] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:27 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1318 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:29.940141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6cfde927-0e9b-43cd-aa81-4adc473f8997 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:29.941562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6cfde927-0e9b-43cd-aa81-4adc473f8997 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:29.978779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6cfde927-0e9b-43cd-aa81-4adc473f8997 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:29.982112 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6cfde927-0e9b-43cd-aa81-4adc473f8997 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:29.989592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6cfde927-0e9b-43cd-aa81-4adc473f8997 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:29.990449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6cfde927-0e9b-43cd-aa81-4adc473f8997 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:30.122392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ec6d8e3f-3dc4-4cf1-9f32-87d0bdce4f0f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:30.123958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ec6d8e3f-3dc4-4cf1-9f32-87d0bdce4f0f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:30.170735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec6d8e3f-3dc4-4cf1-9f32-87d0bdce4f0f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:30.171624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec6d8e3f-3dc4-4cf1-9f32-87d0bdce4f0f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:30.173188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec6d8e3f-3dc4-4cf1-9f32-87d0bdce4f0f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:30.174043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec6d8e3f-3dc4-4cf1-9f32-87d0bdce4f0f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:30.432618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ec6d8e3f-3dc4-4cf1-9f32-87d0bdce4f0f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 26792 microversion: 2.20 time: 0.314208 Apr 21 14:40:30.433930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 105/191] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:30 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 26792 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:30.457043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-59c2da6b-afae-405f-a995-ea94983cf340 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:30.470468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-59c2da6b-afae-405f-a995-ea94983cf340 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:30.480252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c2da6b-afae-405f-a995-ea94983cf340 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:30.481014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c2da6b-afae-405f-a995-ea94983cf340 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:30.482215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c2da6b-afae-405f-a995-ea94983cf340 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:30.482922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c2da6b-afae-405f-a995-ea94983cf340 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:30.954209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-59c2da6b-afae-405f-a995-ea94983cf340 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:31.005275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-59c2da6b-afae-405f-a995-ea94983cf340 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1318 microversion: 2.1 time: 0.568897 Apr 21 14:40:31.025521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 106/192] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:30 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:31.241382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6cfde927-0e9b-43cd-aa81-4adc473f8997 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:31.256909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6cfde927-0e9b-43cd-aa81-4adc473f8997 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 1.318972 Apr 21 14:40:31.257747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 87/193] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:29 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:31.453136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0b880d7b-24f1-4a05-8eca-172e9f268915 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:31.454949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0b880d7b-24f1-4a05-8eca-172e9f268915 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:31.489117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b880d7b-24f1-4a05-8eca-172e9f268915 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:31.490520 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b880d7b-24f1-4a05-8eca-172e9f268915 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:31.492379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b880d7b-24f1-4a05-8eca-172e9f268915 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:31.493501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b880d7b-24f1-4a05-8eca-172e9f268915 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:31.743521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0b880d7b-24f1-4a05-8eca-172e9f268915 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 27592 microversion: 2.20 time: 0.296213 Apr 21 14:40:31.752078 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 107/194] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:31 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 27592 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:32.040243 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a1151a5a-ba5f-4320-bb06-afc88131746f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:32.040934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a1151a5a-ba5f-4320-bb06-afc88131746f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:32.049537 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1151a5a-ba5f-4320-bb06-afc88131746f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:32.050101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1151a5a-ba5f-4320-bb06-afc88131746f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:32.051326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1151a5a-ba5f-4320-bb06-afc88131746f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:32.051826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1151a5a-ba5f-4320-bb06-afc88131746f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:32.279219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c3ba377-3ad1-443a-bcef-b27b8ef97f9b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:32.280410 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9c3ba377-3ad1-443a-bcef-b27b8ef97f9b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:32.293333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c3ba377-3ad1-443a-bcef-b27b8ef97f9b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:32.294729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c3ba377-3ad1-443a-bcef-b27b8ef97f9b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:32.296337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c3ba377-3ad1-443a-bcef-b27b8ef97f9b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:32.297080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c3ba377-3ad1-443a-bcef-b27b8ef97f9b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:32.379931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a1151a5a-ba5f-4320-bb06-afc88131746f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:32.393238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a1151a5a-ba5f-4320-bb06-afc88131746f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1318 microversion: 2.1 time: 0.356903 Apr 21 14:40:32.395195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 88/195] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:32 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:32.761396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7fc8418e-a6f8-44f7-a75e-cbbb0763fc37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:32.762480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7fc8418e-a6f8-44f7-a75e-cbbb0763fc37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:32.772011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7fc8418e-a6f8-44f7-a75e-cbbb0763fc37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:32.779539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7fc8418e-a6f8-44f7-a75e-cbbb0763fc37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:32.780475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7fc8418e-a6f8-44f7-a75e-cbbb0763fc37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:32.780981 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7fc8418e-a6f8-44f7-a75e-cbbb0763fc37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:32.893687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9c3ba377-3ad1-443a-bcef-b27b8ef97f9b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:32.909233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c3ba377-3ad1-443a-bcef-b27b8ef97f9b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.636110 Apr 21 14:40:32.910204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 108/196] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:32 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:33.019694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7fc8418e-a6f8-44f7-a75e-cbbb0763fc37 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 27904 microversion: 2.20 time: 0.263137 Apr 21 14:40:33.020541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 89/197] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:32 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 27904 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:33.414064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b88578ae-c3bc-47ec-810e-5cf30d5e29be tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:33.415263 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b88578ae-c3bc-47ec-810e-5cf30d5e29be tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:33.434563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b88578ae-c3bc-47ec-810e-5cf30d5e29be tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:33.435309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b88578ae-c3bc-47ec-810e-5cf30d5e29be tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:33.436518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b88578ae-c3bc-47ec-810e-5cf30d5e29be tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:33.437153 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b88578ae-c3bc-47ec-810e-5cf30d5e29be tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:33.932015 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab393cf3-7986-4b9d-b964-d41c6717d647 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:33.933583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ab393cf3-7986-4b9d-b964-d41c6717d647 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:33.987439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab393cf3-7986-4b9d-b964-d41c6717d647 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:33.991933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab393cf3-7986-4b9d-b964-d41c6717d647 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:33.993886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab393cf3-7986-4b9d-b964-d41c6717d647 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:33.998118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab393cf3-7986-4b9d-b964-d41c6717d647 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:34.471067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ab393cf3-7986-4b9d-b964-d41c6717d647 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:34.484181 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ab393cf3-7986-4b9d-b964-d41c6717d647 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.560160 Apr 21 14:40:34.485193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 90/198] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:33 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:34.493649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aab7d7b6-5d81-4c64-b807-bf5012f29fe5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:34.495402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aab7d7b6-5d81-4c64-b807-bf5012f29fe5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:34.513291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aab7d7b6-5d81-4c64-b807-bf5012f29fe5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:34.514037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aab7d7b6-5d81-4c64-b807-bf5012f29fe5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:34.515479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aab7d7b6-5d81-4c64-b807-bf5012f29fe5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:34.516616 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aab7d7b6-5d81-4c64-b807-bf5012f29fe5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:34.644353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aab7d7b6-5d81-4c64-b807-bf5012f29fe5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.157205 Apr 21 14:40:34.645075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 91/199] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:34 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:34.653729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-11187c50-73a7-4aff-92c5-d4a7247a51f5 req-3f5d6a97-64e3-4b34-8908-f67a53d0354a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7219388-ce17-45a3-b762-ddb8f62f57d4", "name": "network-vif-plugged", "status": "completed", "tag": "c8eaff5b-4a42-4389-bc4b-1592ce5859e2"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:34.657550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:40:34.657550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:40:34.671689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-11187c50-73a7-4aff-92c5-d4a7247a51f5 req-3f5d6a97-64e3-4b34-8908-f67a53d0354a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:34.672502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-11187c50-73a7-4aff-92c5-d4a7247a51f5 req-3f5d6a97-64e3-4b34-8908-f67a53d0354a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:34.709173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-11187c50-73a7-4aff-92c5-d4a7247a51f5 req-3f5d6a97-64e3-4b34-8908-f67a53d0354a service nova] Creating event network-vif-plugged:c8eaff5b-4a42-4389-bc4b-1592ce5859e2 for instance d7219388-ce17-45a3-b762-ddb8f62f57d4 on hv-cinder-78638 Apr 21 14:40:34.714048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b88578ae-c3bc-47ec-810e-5cf30d5e29be tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:34.719281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-11187c50-73a7-4aff-92c5-d4a7247a51f5 req-3f5d6a97-64e3-4b34-8908-f67a53d0354a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071657 Apr 21 14:40:34.724137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b88578ae-c3bc-47ec-810e-5cf30d5e29be tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1318 microversion: 2.1 time: 1.314788 Apr 21 14:40:34.724281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 92/200] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:40:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:34.725430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 109/201] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:33 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1318 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:34.736170 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ded22917-9e55-4122-9dbe-0b90b652f903 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19df14ad08>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:34.886562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ded22917-9e55-4122-9dbe-0b90b652f903 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8f9027c6-d80c-41b5-8b62-45dcce4ceeb3" status: 200 len: 351 microversion: 2.1 time: 0.160357 Apr 21 14:40:34.887230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 93/202] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:40:34 2021] GET /compute/v2.1/os-volumes/8f9027c6-d80c-41b5-8b62-45dcce4ceeb3 => generated 351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:35.389851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1505407618", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:35.509437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a81f8fca-ad96-4851-b090-507b60848395 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:35.510991 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a81f8fca-ad96-4851-b090-507b60848395 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:35.545681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a81f8fca-ad96-4851-b090-507b60848395 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:35.548704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a81f8fca-ad96-4851-b090-507b60848395 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:35.553852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a81f8fca-ad96-4851-b090-507b60848395 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:35.560909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a81f8fca-ad96-4851-b090-507b60848395 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:35.604423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] validate_networks() for None {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:40:36.070130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a81f8fca-ad96-4851-b090-507b60848395 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:36.096084 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a81f8fca-ad96-4851-b090-507b60848395 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.594728 Apr 21 14:40:36.097929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 94/203] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:35 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:36.121135 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7146a0ae-6fb0-45ec-9075-23e64153c616 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:36.123505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7146a0ae-6fb0-45ec-9075-23e64153c616 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:36.140498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7146a0ae-6fb0-45ec-9075-23e64153c616 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:36.141264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7146a0ae-6fb0-45ec-9075-23e64153c616 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:36.143059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7146a0ae-6fb0-45ec-9075-23e64153c616 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:36.143936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7146a0ae-6fb0-45ec-9075-23e64153c616 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:36.170893 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:40:36.171874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:40:36.172608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:40:36.173267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:40:36.173912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:40:36.196426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:36.197471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:36.198636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:36.199337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:36.259611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Getting quotas for project ba090b5b640c4c62bc71d826adeba33c. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:40:36.267430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Getting quotas for user c62046f89a614d8a9abfb132be4328e4 and project ba090b5b640c4c62bc71d826adeba33c. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:40:36.292074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:40:36.298112 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:40:36.394313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7146a0ae-6fb0-45ec-9075-23e64153c616 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.293860 Apr 21 14:40:36.401764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 95/204] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:36 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:36.418557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3b7394b-dcb3-47be-a92d-3bbac91165c0 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:36.420135 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a3b7394b-dcb3-47be-a92d-3bbac91165c0 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:36.457423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3b7394b-dcb3-47be-a92d-3bbac91165c0 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:36.459930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-13a914df-4fbf-44d7-8202-8a25738d4fa4 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073684 Apr 21 14:40:36.461485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3b7394b-dcb3-47be-a92d-3bbac91165c0 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:36.462899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 110/205] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:40:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:40:36.464596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3b7394b-dcb3-47be-a92d-3bbac91165c0 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:36.465543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3b7394b-dcb3-47be-a92d-3bbac91165c0 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:36.483778 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-df7a8a8e-a0e4-4cd4-af5d-3857435f336c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:36.485056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-df7a8a8e-a0e4-4cd4-af5d-3857435f336c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:36.807325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-df7a8a8e-a0e4-4cd4-af5d-3857435f336c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:36.823207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-df7a8a8e-a0e4-4cd4-af5d-3857435f336c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1215 microversion: 2.1 time: 0.352212 Apr 21 14:40:36.831698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 111/206] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:36 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1215 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:37.115855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2d635d98-6b2e-451d-a33d-8b9b401b84a3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:37.116543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2d635d98-6b2e-451d-a33d-8b9b401b84a3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:37.132906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d635d98-6b2e-451d-a33d-8b9b401b84a3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:37.133760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d635d98-6b2e-451d-a33d-8b9b401b84a3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:37.139434 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d635d98-6b2e-451d-a33d-8b9b401b84a3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:37.140107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d635d98-6b2e-451d-a33d-8b9b401b84a3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:37.356490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a3b7394b-dcb3-47be-a92d-3bbac91165c0 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:37.370407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a3b7394b-dcb3-47be-a92d-3bbac91165c0 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1318 microversion: 2.1 time: 0.972417 Apr 21 14:40:37.371666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 96/207] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:36 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1318 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:37.393251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0755cb97-4626-45f8-92bd-5108e05b2e58 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19e06fa378>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:37.588452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0755cb97-4626-45f8-92bd-5108e05b2e58 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/91b8eafc-8986-4c84-bf12-455246d5ad2d" status: 200 len: 350 microversion: 2.1 time: 0.215000 Apr 21 14:40:37.589809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 97/208] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:40:37 2021] GET /compute/v2.1/os-volumes/91b8eafc-8986-4c84-bf12-455246d5ad2d => generated 350 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:37.606564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4a27547c-5cd9-46f8-b3e6-56828e1b78cd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:37.613510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4a27547c-5cd9-46f8-b3e6-56828e1b78cd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:37.650199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a27547c-5cd9-46f8-b3e6-56828e1b78cd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:37.653743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a27547c-5cd9-46f8-b3e6-56828e1b78cd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:37.657391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a27547c-5cd9-46f8-b3e6-56828e1b78cd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:37.658473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a27547c-5cd9-46f8-b3e6-56828e1b78cd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:37.931355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4a27547c-5cd9-46f8-b3e6-56828e1b78cd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.337963 Apr 21 14:40:37.932018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 98/209] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:37 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:37.952278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-042e20af-a91b-44d3-842f-e214c9e17497 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:37.953729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-042e20af-a91b-44d3-842f-e214c9e17497 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:37.971738 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-042e20af-a91b-44d3-842f-e214c9e17497 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:37.972709 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-042e20af-a91b-44d3-842f-e214c9e17497 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:37.974483 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-042e20af-a91b-44d3-842f-e214c9e17497 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:37.975456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-042e20af-a91b-44d3-842f-e214c9e17497 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:38.177363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2d635d98-6b2e-451d-a33d-8b9b401b84a3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:38.193870 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2d635d98-6b2e-451d-a33d-8b9b401b84a3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 1.082522 Apr 21 14:40:38.197574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 112/210] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:37 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:38.405263 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0a15807c-d513-440c-b13e-96348f55c4ae tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:38.406390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0a15807c-d513-440c-b13e-96348f55c4ae tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:38.427074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-042e20af-a91b-44d3-842f-e214c9e17497 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:38.439064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-042e20af-a91b-44d3-842f-e214c9e17497 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1267 microversion: 2.1 time: 0.498540 Apr 21 14:40:38.439903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 99/211] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:37 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1267 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:38.472302 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a15807c-d513-440c-b13e-96348f55c4ae tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:38.473645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a15807c-d513-440c-b13e-96348f55c4ae tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:38.475660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a15807c-d513-440c-b13e-96348f55c4ae tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:38.476869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a15807c-d513-440c-b13e-96348f55c4ae tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:38.954405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4cdfbb41-c7c5-4dec-8e11-abf233e69c56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:38.958982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4cdfbb41-c7c5-4dec-8e11-abf233e69c56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:39.019995 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cdfbb41-c7c5-4dec-8e11-abf233e69c56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:39.032388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cdfbb41-c7c5-4dec-8e11-abf233e69c56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:39.034567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cdfbb41-c7c5-4dec-8e11-abf233e69c56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:39.042152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cdfbb41-c7c5-4dec-8e11-abf233e69c56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:39.422274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4cdfbb41-c7c5-4dec-8e11-abf233e69c56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.477352 Apr 21 14:40:39.424760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 100/212] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:38 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:40:39.443261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ba05990-c3d4-4b96-9d98-afa19d84c781 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:39.445687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2ba05990-c3d4-4b96-9d98-afa19d84c781 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:39.473418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ba05990-c3d4-4b96-9d98-afa19d84c781 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:39.474736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ba05990-c3d4-4b96-9d98-afa19d84c781 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:39.476641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ba05990-c3d4-4b96-9d98-afa19d84c781 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:39.477824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ba05990-c3d4-4b96-9d98-afa19d84c781 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:39.666560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0a15807c-d513-440c-b13e-96348f55c4ae tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:39.680666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0a15807c-d513-440c-b13e-96348f55c4ae tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1508 microversion: 2.1 time: 1.283160 Apr 21 14:40:39.694143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 113/213] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:38 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1508 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:39.700386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d4b47843-35c5-41d0-be92-49035d73a8f8 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:39.701308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d4b47843-35c5-41d0-be92-49035d73a8f8 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:39.709914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4b47843-35c5-41d0-be92-49035d73a8f8 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:39.710819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4b47843-35c5-41d0-be92-49035d73a8f8 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:39.711849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4b47843-35c5-41d0-be92-49035d73a8f8 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:39.712482 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4b47843-35c5-41d0-be92-49035d73a8f8 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:39.934195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d4b47843-35c5-41d0-be92-49035d73a8f8 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:39.959274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d4b47843-35c5-41d0-be92-49035d73a8f8 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1273 microversion: 2.1 time: 0.263062 Apr 21 14:40:39.964595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 114/214] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:39 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1273 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:39.969246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-95c42ad5-cf6d-4492-85d2-4790174da1b9 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19de859730>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:40.146008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-95c42ad5-cf6d-4492-85d2-4790174da1b9 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/feb26999-946a-442e-a482-57f409a5b8f5" status: 200 len: 349 microversion: 2.1 time: 0.180340 Apr 21 14:40:40.147236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 115/215] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:40:39 2021] GET /compute/v2.1/os-volumes/feb26999-946a-442e-a482-57f409a5b8f5 => generated 349 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:40.155931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ba05990-c3d4-4b96-9d98-afa19d84c781 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:40.165455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c445b2a9-3772-48b1-a84f-c3db9720686e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79de1dec-0f5f-475f-803d-7e45e4d3edfb"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:40.168572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c445b2a9-3772-48b1-a84f-c3db9720686e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:40.169884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ba05990-c3d4-4b96-9d98-afa19d84c781 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.742349 Apr 21 14:40:40.170617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 101/216] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:39 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:40.187409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c445b2a9-3772-48b1-a84f-c3db9720686e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:40.189080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c445b2a9-3772-48b1-a84f-c3db9720686e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:40.191339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c445b2a9-3772-48b1-a84f-c3db9720686e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:40.192504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c445b2a9-3772-48b1-a84f-c3db9720686e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:40.197502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-38c7c91e-9e7c-4175-9998-625a8c41882c tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19df12e7b8>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:40.333755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-38c7c91e-9e7c-4175-9998-625a8c41882c tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.148483 Apr 21 14:40:40.334482 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 102/217] 10.222.0.24 () {58 vars in 1124 bytes} [Wed Apr 21 14:40:40 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:40.348014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4894c01c-edd6-4fc0-adde-6c746b910046 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19df12eea0>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:40.580730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-c445b2a9-3772-48b1-a84f-c3db9720686e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] HTTP exception thrown: Invalid volume: volume 79de1dec-0f5f-475f-803d-7e45e4d3edfb is already attached to instances: 502a82df-ee66-408d-ab9e-8207516c0415 Apr 21 14:40:40.583638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c445b2a9-3772-48b1-a84f-c3db9720686e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Returning 400 to user: Invalid volume: volume 79de1dec-0f5f-475f-803d-7e45e4d3edfb is already attached to instances: 502a82df-ee66-408d-ab9e-8207516c0415 {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:40:40.586124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c445b2a9-3772-48b1-a84f-c3db9720686e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "POST /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.436476 Apr 21 14:40:40.588212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 116/218] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:40:40 2021] POST /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4/os-volume_attachments => generated 174 bytes in 440 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:40:40.600866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0c25d63a-a535-444e-b944-2990802e3bf8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:40.603339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0c25d63a-a535-444e-b944-2990802e3bf8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:40.621593 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c25d63a-a535-444e-b944-2990802e3bf8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:40.622676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c25d63a-a535-444e-b944-2990802e3bf8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:40.625312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c25d63a-a535-444e-b944-2990802e3bf8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:40.627332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c25d63a-a535-444e-b944-2990802e3bf8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:40.628394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4894c01c-edd6-4fc0-adde-6c746b910046 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.284489 Apr 21 14:40:40.629591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 103/219] 10.222.0.24 () {58 vars in 1139 bytes} [Wed Apr 21 14:40:40 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:40.642895 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-025584b0-9c17-418b-8913-9115fb78dca3 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19df14a840>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:40.805214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0c25d63a-a535-444e-b944-2990802e3bf8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.214602 Apr 21 14:40:40.807081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 117/220] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:40 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:40.866587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72a61692-f013-4673-8bbf-3d87a886a51d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:40.867310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-72a61692-f013-4673-8bbf-3d87a886a51d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:40.888652 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72a61692-f013-4673-8bbf-3d87a886a51d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:40.889667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72a61692-f013-4673-8bbf-3d87a886a51d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:40.890621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72a61692-f013-4673-8bbf-3d87a886a51d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:40.891128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72a61692-f013-4673-8bbf-3d87a886a51d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:41.008206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-025584b0-9c17-418b-8913-9115fb78dca3 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.368274 Apr 21 14:40:41.014632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 104/221] 10.222.0.24 () {58 vars in 1124 bytes} [Wed Apr 21 14:40:40 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:41.044260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c3b074a1-c0e4-45dc-9a88-01f623c13b29 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:41.048095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c3b074a1-c0e4-45dc-9a88-01f623c13b29 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:41.075672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3b074a1-c0e4-45dc-9a88-01f623c13b29 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:41.077319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3b074a1-c0e4-45dc-9a88-01f623c13b29 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:41.080366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3b074a1-c0e4-45dc-9a88-01f623c13b29 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:41.081316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3b074a1-c0e4-45dc-9a88-01f623c13b29 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:41.350923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-72a61692-f013-4673-8bbf-3d87a886a51d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lazy-loading 'services' on Instance uuid 502a82df-ee66-408d-ab9e-8207516c0415 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:40:41.742552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c3b074a1-c0e4-45dc-9a88-01f623c13b29 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:41.758163 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-72a61692-f013-4673-8bbf-3d87a886a51d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415/os-volume_attachments/79de1dec-0f5f-475f-803d-7e45e4d3edfb" status: 202 len: 0 microversion: 2.1 time: 0.897361 Apr 21 14:40:41.758989 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 118/222] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:40:40 2021] DELETE /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415/os-volume_attachments/79de1dec-0f5f-475f-803d-7e45e4d3edfb => generated 0 bytes in 900 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:40:41.794186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c3b074a1-c0e4-45dc-9a88-01f623c13b29 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1315 microversion: 2.1 time: 0.777171 Apr 21 14:40:41.795340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 105/223] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:41 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:41.806751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b18ed2b3-8759-4859-b3b6-e0789fc67230 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19dfc34f28>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:41.810641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5867bdfe-c6fe-4dfd-aebd-f7a834649018 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:41.811323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5867bdfe-c6fe-4dfd-aebd-f7a834649018 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:41.839498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5867bdfe-c6fe-4dfd-aebd-f7a834649018 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:41.840019 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5867bdfe-c6fe-4dfd-aebd-f7a834649018 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:41.840915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5867bdfe-c6fe-4dfd-aebd-f7a834649018 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:41.841417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5867bdfe-c6fe-4dfd-aebd-f7a834649018 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:42.168679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b18ed2b3-8759-4859-b3b6-e0789fc67230 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.406331 Apr 21 14:40:42.169498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 119/224] 10.222.0.24 () {58 vars in 1157 bytes} [Wed Apr 21 14:40:41 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:42.183836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-02218159-39ac-4b30-9def-0d1e9ac2105c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:42.185042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-02218159-39ac-4b30-9def-0d1e9ac2105c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:42.196200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02218159-39ac-4b30-9def-0d1e9ac2105c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:42.196960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02218159-39ac-4b30-9def-0d1e9ac2105c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:42.198842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02218159-39ac-4b30-9def-0d1e9ac2105c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:42.200006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02218159-39ac-4b30-9def-0d1e9ac2105c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:42.357220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-02218159-39ac-4b30-9def-0d1e9ac2105c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.177201 Apr 21 14:40:42.357701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 120/225] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:42 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:42.363677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-439b29b8-fa14-46ca-90f9-8c8ebc6a3c6d tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19de936158>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:42.491561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-439b29b8-fa14-46ca-90f9-8c8ebc6a3c6d tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.132447 Apr 21 14:40:42.492261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 121/226] 10.222.0.24 () {58 vars in 1160 bytes} [Wed Apr 21 14:40:42 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:42.508099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8587686e-82e5-4a4f-97b9-df96e6794e23 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19de9360d0>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:42.536701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5867bdfe-c6fe-4dfd-aebd-f7a834649018 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:42.556785 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5867bdfe-c6fe-4dfd-aebd-f7a834649018 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.759813 Apr 21 14:40:42.557462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 106/227] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:41 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:42.670905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8587686e-82e5-4a4f-97b9-df96e6794e23 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.167436 Apr 21 14:40:42.671977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 122/228] 10.222.0.24 () {58 vars in 1145 bytes} [Wed Apr 21 14:40:42 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:42.687394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2901163d-6db8-4b98-8e13-ea3e1fb80e53 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19df1246a8>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:42.813072 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-99a6d390-b88f-41b1-9577-93631ff3dd74 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:42.813924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-99a6d390-b88f-41b1-9577-93631ff3dd74 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:42.838254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-99a6d390-b88f-41b1-9577-93631ff3dd74 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:42.838782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-99a6d390-b88f-41b1-9577-93631ff3dd74 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:42.839666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-99a6d390-b88f-41b1-9577-93631ff3dd74 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:42.840185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-99a6d390-b88f-41b1-9577-93631ff3dd74 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:42.891686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2901163d-6db8-4b98-8e13-ea3e1fb80e53 tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.209770 Apr 21 14:40:42.894565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 107/229] 10.222.0.24 () {58 vars in 1178 bytes} [Wed Apr 21 14:40:42 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:42.929574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-12ab4157-81b5-46ad-a0d5-e40c59a88ffe tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] Calling method '.version_select at 0x7f19df12e620>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:43.127724 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-12ab4157-81b5-46ad-a0d5-e40c59a88ffe tempest-VolumesTestJSON-1842483912 tempest-VolumesTestJSON-1842483912-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.217969 Apr 21 14:40:43.143179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 108/230] 10.222.0.24 () {58 vars in 1145 bytes} [Wed Apr 21 14:40:42 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:43.369908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3fb09de1-44bc-4aca-b4bb-b68b6df2be5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:43.372122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3fb09de1-44bc-4aca-b4bb-b68b6df2be5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:43.405080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fb09de1-44bc-4aca-b4bb-b68b6df2be5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:43.414494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fb09de1-44bc-4aca-b4bb-b68b6df2be5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:43.417406 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fb09de1-44bc-4aca-b4bb-b68b6df2be5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:43.417971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fb09de1-44bc-4aca-b4bb-b68b6df2be5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:43.614911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3fb09de1-44bc-4aca-b4bb-b68b6df2be5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.248302 Apr 21 14:40:43.616426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 109/231] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:43 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:40:43.637779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d7dd1e14-d812-4fae-bda9-9af9df33d6c5 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:43.639247 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d7dd1e14-d812-4fae-bda9-9af9df33d6c5 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:43.676442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7dd1e14-d812-4fae-bda9-9af9df33d6c5 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:43.677364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7dd1e14-d812-4fae-bda9-9af9df33d6c5 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:43.681282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7dd1e14-d812-4fae-bda9-9af9df33d6c5 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:43.682244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7dd1e14-d812-4fae-bda9-9af9df33d6c5 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:43.922357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-99a6d390-b88f-41b1-9577-93631ff3dd74 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:43.933612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-99a6d390-b88f-41b1-9577-93631ff3dd74 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1315 microversion: 2.1 time: 1.124508 Apr 21 14:40:43.942871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 123/232] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:42 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1315 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:43.953779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1532650087", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "networks": [{"uuid": "d7586439-5692-45b4-a121-4de98b0d3272"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:44.149231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] validate_networks() for [('d7586439-5692-45b4-a121-4de98b0d3272', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:40:44.201329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d7dd1e14-d812-4fae-bda9-9af9df33d6c5 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:44.221306 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d7dd1e14-d812-4fae-bda9-9af9df33d6c5 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.600687 Apr 21 14:40:44.221306 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 110/233] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:43 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:44.230680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-82eab69e-d009-476e-aa86-03937f68d5b6 req-f1b0d6ea-13ea-4ba4-adf4-863aba65179a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2504706a-701f-4da9-90ec-425515785e61", "tag": "cc566d32-eb8b-44f2-807f-f7a1fae9c0f5"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:44.234636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:40:44.234636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:40:44.262264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-82eab69e-d009-476e-aa86-03937f68d5b6 req-f1b0d6ea-13ea-4ba4-adf4-863aba65179a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:44.263223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-82eab69e-d009-476e-aa86-03937f68d5b6 req-f1b0d6ea-13ea-4ba4-adf4-863aba65179a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:44.317712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-82eab69e-d009-476e-aa86-03937f68d5b6 req-f1b0d6ea-13ea-4ba4-adf4-863aba65179a service nova] Creating event network-changed:cc566d32-eb8b-44f2-807f-f7a1fae9c0f5 for instance 2504706a-701f-4da9-90ec-425515785e61 on hv-cinder-78638 Apr 21 14:40:44.324198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-82eab69e-d009-476e-aa86-03937f68d5b6 req-f1b0d6ea-13ea-4ba4-adf4-863aba65179a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101072 Apr 21 14:40:44.341270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 111/234] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:40:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:44.636008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-87ce4984-d910-4e3d-b3d7-17a293faed3a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:44.638335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-87ce4984-d910-4e3d-b3d7-17a293faed3a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:44.656611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87ce4984-d910-4e3d-b3d7-17a293faed3a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:44.658227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87ce4984-d910-4e3d-b3d7-17a293faed3a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:44.660361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87ce4984-d910-4e3d-b3d7-17a293faed3a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:44.661619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87ce4984-d910-4e3d-b3d7-17a293faed3a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:44.883570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-87ce4984-d910-4e3d-b3d7-17a293faed3a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.257248 Apr 21 14:40:44.884711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 112/235] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:44 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:44.969465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-da828f10-b1ad-40d7-ade4-a4f80ef649bd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:44.972590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-da828f10-b1ad-40d7-ade4-a4f80ef649bd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:45.030936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da828f10-b1ad-40d7-ade4-a4f80ef649bd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:45.037688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da828f10-b1ad-40d7-ade4-a4f80ef649bd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:45.039014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da828f10-b1ad-40d7-ade4-a4f80ef649bd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:45.039731 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da828f10-b1ad-40d7-ade4-a4f80ef649bd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:45.462271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da828f10-b1ad-40d7-ade4-a4f80ef649bd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:45.480265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-da828f10-b1ad-40d7-ade4-a4f80ef649bd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1315 microversion: 2.1 time: 0.522277 Apr 21 14:40:45.496250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 113/236] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:44 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:45.502444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-67899eb7-640e-4ce6-8f41-764a928bf524 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:45.503683 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-67899eb7-640e-4ce6-8f41-764a928bf524 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:45.515384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67899eb7-640e-4ce6-8f41-764a928bf524 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:45.515902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67899eb7-640e-4ce6-8f41-764a928bf524 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:45.516777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67899eb7-640e-4ce6-8f41-764a928bf524 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:45.517271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67899eb7-640e-4ce6-8f41-764a928bf524 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:45.889624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-67899eb7-640e-4ce6-8f41-764a928bf524 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:45.907968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-67899eb7-640e-4ce6-8f41-764a928bf524 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.410250 Apr 21 14:40:45.908548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 114/237] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:45 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:45.925027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-54fac24e-a9cb-4263-bdd8-da5bd67b38e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:45.926634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-54fac24e-a9cb-4263-bdd8-da5bd67b38e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:45.936407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54fac24e-a9cb-4263-bdd8-da5bd67b38e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:45.936407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54fac24e-a9cb-4263-bdd8-da5bd67b38e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:45.937373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54fac24e-a9cb-4263-bdd8-da5bd67b38e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:45.937870 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54fac24e-a9cb-4263-bdd8-da5bd67b38e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:45.980999 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:40:45.981719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:40:45.993100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:40:45.994544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:40:45.995270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:40:46.016612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:46.017264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:46.018427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:46.025389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:46.071125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Getting quotas for project c273beec5c4c4f89a4c7c896497de7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:40:46.083909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Getting quotas for user fc4c490791d14d0981977c2544a8f9c5 and project c273beec5c4c4f89a4c7c896497de7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:40:46.126483 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:40:46.131212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:40:46.244629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f9011ce6-a72c-4cac-89ed-d33ca033c9bd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.300052 Apr 21 14:40:46.246039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 124/238] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:40:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:40:46.266634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bb14ea78-7547-4999-b25d-85c3a755ca92 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:46.267318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bb14ea78-7547-4999-b25d-85c3a755ca92 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:46.394272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bb14ea78-7547-4999-b25d-85c3a755ca92 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:46.408490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bb14ea78-7547-4999-b25d-85c3a755ca92 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1218 microversion: 2.1 time: 0.146187 Apr 21 14:40:46.409763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 125/239] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:46 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:46.517870 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fe24f19a-7cd7-4f29-b783-4b96186ac35c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:46.521811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fe24f19a-7cd7-4f29-b783-4b96186ac35c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:46.538636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe24f19a-7cd7-4f29-b783-4b96186ac35c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:46.540427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe24f19a-7cd7-4f29-b783-4b96186ac35c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:46.542079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe24f19a-7cd7-4f29-b783-4b96186ac35c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:46.544156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe24f19a-7cd7-4f29-b783-4b96186ac35c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:46.587769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-54fac24e-a9cb-4263-bdd8-da5bd67b38e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.666533 Apr 21 14:40:46.589270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 115/240] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:45 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:46.933570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-18f6aba5-0fff-4a89-a577-6e28470eb7e1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:46.946056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-18f6aba5-0fff-4a89-a577-6e28470eb7e1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:46.973909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18f6aba5-0fff-4a89-a577-6e28470eb7e1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:46.975169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18f6aba5-0fff-4a89-a577-6e28470eb7e1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:46.977015 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18f6aba5-0fff-4a89-a577-6e28470eb7e1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:46.986918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18f6aba5-0fff-4a89-a577-6e28470eb7e1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:47.748349 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-18f6aba5-0fff-4a89-a577-6e28470eb7e1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:47.766926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-18f6aba5-0fff-4a89-a577-6e28470eb7e1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.841970 Apr 21 14:40:47.767871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 116/241] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:46 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:47.785159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fbed22a1-1298-4b11-b460-5882d29f5eb7 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:47.786258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fbed22a1-1298-4b11-b460-5882d29f5eb7 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:47.800923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbed22a1-1298-4b11-b460-5882d29f5eb7 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:47.810410 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbed22a1-1298-4b11-b460-5882d29f5eb7 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:47.811730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbed22a1-1298-4b11-b460-5882d29f5eb7 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:47.813010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbed22a1-1298-4b11-b460-5882d29f5eb7 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:47.867467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fe24f19a-7cd7-4f29-b783-4b96186ac35c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:47.931835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fe24f19a-7cd7-4f29-b783-4b96186ac35c tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1315 microversion: 2.1 time: 1.419126 Apr 21 14:40:47.932736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 126/242] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:46 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1315 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:47.959514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-554fc76f-0776-4230-a8cf-a40dd26032c1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:47.961456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-554fc76f-0776-4230-a8cf-a40dd26032c1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:48.029013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-554fc76f-0776-4230-a8cf-a40dd26032c1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:48.029844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-554fc76f-0776-4230-a8cf-a40dd26032c1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:48.031510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-554fc76f-0776-4230-a8cf-a40dd26032c1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:48.032217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-554fc76f-0776-4230-a8cf-a40dd26032c1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:48.150542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fbed22a1-1298-4b11-b460-5882d29f5eb7 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:48.173377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fbed22a1-1298-4b11-b460-5882d29f5eb7 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1270 microversion: 2.1 time: 0.402836 Apr 21 14:40:48.174383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 117/243] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:47 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1270 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:48.187768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-554fc76f-0776-4230-a8cf-a40dd26032c1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.253263 Apr 21 14:40:48.189298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 127/244] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:47 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:48.798775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f55fc45a-21d4-4aee-8c3a-fa3e6ef19d8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:48.799575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f55fc45a-21d4-4aee-8c3a-fa3e6ef19d8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:48.809120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f55fc45a-21d4-4aee-8c3a-fa3e6ef19d8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:48.809944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f55fc45a-21d4-4aee-8c3a-fa3e6ef19d8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:48.811034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f55fc45a-21d4-4aee-8c3a-fa3e6ef19d8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:48.811738 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f55fc45a-21d4-4aee-8c3a-fa3e6ef19d8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:48.965591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ba9ad2d6-c274-4cb1-9d2d-f17d5558c9ae tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:48.967235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ba9ad2d6-c274-4cb1-9d2d-f17d5558c9ae tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:48.993521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba9ad2d6-c274-4cb1-9d2d-f17d5558c9ae tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:49.007333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba9ad2d6-c274-4cb1-9d2d-f17d5558c9ae tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:49.014286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba9ad2d6-c274-4cb1-9d2d-f17d5558c9ae tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:49.015310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba9ad2d6-c274-4cb1-9d2d-f17d5558c9ae tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:49.730624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f55fc45a-21d4-4aee-8c3a-fa3e6ef19d8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:49.751851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f55fc45a-21d4-4aee-8c3a-fa3e6ef19d8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 0.957714 Apr 21 14:40:49.762753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 118/245] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:48 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:49.768451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6edc44ad-e264-4055-b403-f98c5d919cf1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:49.769560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6edc44ad-e264-4055-b403-f98c5d919cf1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:49.778651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6edc44ad-e264-4055-b403-f98c5d919cf1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:49.779167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6edc44ad-e264-4055-b403-f98c5d919cf1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:49.780043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6edc44ad-e264-4055-b403-f98c5d919cf1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:49.780540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6edc44ad-e264-4055-b403-f98c5d919cf1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:49.965312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6edc44ad-e264-4055-b403-f98c5d919cf1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28200 microversion: 2.20 time: 0.200134 Apr 21 14:40:49.967100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 119/246] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:49 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28200 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:49.978299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c65ec6a9-c273-4dbc-801c-3bad4d141acd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:49.980330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c65ec6a9-c273-4dbc-801c-3bad4d141acd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:50.029978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c65ec6a9-c273-4dbc-801c-3bad4d141acd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:50.038431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c65ec6a9-c273-4dbc-801c-3bad4d141acd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:50.045202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c65ec6a9-c273-4dbc-801c-3bad4d141acd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:50.049407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c65ec6a9-c273-4dbc-801c-3bad4d141acd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:50.140631 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ba9ad2d6-c274-4cb1-9d2d-f17d5558c9ae tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:50.155560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ba9ad2d6-c274-4cb1-9d2d-f17d5558c9ae tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1315 microversion: 2.1 time: 1.195135 Apr 21 14:40:50.159307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 128/247] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:48 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1315 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:50.484443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c65ec6a9-c273-4dbc-801c-3bad4d141acd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:50.535039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c65ec6a9-c273-4dbc-801c-3bad4d141acd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1276 microversion: 2.1 time: 0.563612 Apr 21 14:40:50.536759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 120/248] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:49 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1276 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:50.775364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a8e3adc-8d59-4e38-baf2-70994d809580 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:50.777132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a8e3adc-8d59-4e38-baf2-70994d809580 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:50.793086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a8e3adc-8d59-4e38-baf2-70994d809580 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:50.794069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a8e3adc-8d59-4e38-baf2-70994d809580 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:50.795552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a8e3adc-8d59-4e38-baf2-70994d809580 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:50.796438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a8e3adc-8d59-4e38-baf2-70994d809580 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:50.987201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fd159387-2092-479a-a896-41c68e15a0d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:50.989296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fd159387-2092-479a-a896-41c68e15a0d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:51.022092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd159387-2092-479a-a896-41c68e15a0d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:51.023104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd159387-2092-479a-a896-41c68e15a0d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:51.025106 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd159387-2092-479a-a896-41c68e15a0d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:51.037284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd159387-2092-479a-a896-41c68e15a0d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:51.475133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fd159387-2092-479a-a896-41c68e15a0d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28490 microversion: 2.20 time: 0.496419 Apr 21 14:40:51.477091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 121/249] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:50 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28490 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:51.509315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d99afc2f-47e9-4c0b-af21-2dbb9f1ff77a tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:51.511504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d99afc2f-47e9-4c0b-af21-2dbb9f1ff77a tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:51.549618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d99afc2f-47e9-4c0b-af21-2dbb9f1ff77a tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:51.558804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d99afc2f-47e9-4c0b-af21-2dbb9f1ff77a tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:51.560868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d99afc2f-47e9-4c0b-af21-2dbb9f1ff77a tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:51.565666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d99afc2f-47e9-4c0b-af21-2dbb9f1ff77a tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:52.001699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3a8e3adc-8d59-4e38-baf2-70994d809580 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:52.033451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a8e3adc-8d59-4e38-baf2-70994d809580 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1523 microversion: 2.1 time: 1.265932 Apr 21 14:40:52.055625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 129/250] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:50 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1523 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:52.072308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-79b9cbc9-8764-4482-93ce-8be9e3f51df3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:52.076832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-79b9cbc9-8764-4482-93ce-8be9e3f51df3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:52.100685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79b9cbc9-8764-4482-93ce-8be9e3f51df3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:52.102751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79b9cbc9-8764-4482-93ce-8be9e3f51df3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:52.106250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79b9cbc9-8764-4482-93ce-8be9e3f51df3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:52.108289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79b9cbc9-8764-4482-93ce-8be9e3f51df3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:52.135161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d99afc2f-47e9-4c0b-af21-2dbb9f1ff77a tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:52.174346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d99afc2f-47e9-4c0b-af21-2dbb9f1ff77a tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1315 microversion: 2.1 time: 0.694424 Apr 21 14:40:52.183787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 122/251] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:51 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:52.489729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d4675169-bf53-4661-9b39-01540c01f3d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:52.491340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d4675169-bf53-4661-9b39-01540c01f3d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:52.519322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4675169-bf53-4661-9b39-01540c01f3d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:52.520194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4675169-bf53-4661-9b39-01540c01f3d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:52.523725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4675169-bf53-4661-9b39-01540c01f3d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:52.524508 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4675169-bf53-4661-9b39-01540c01f3d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:52.659678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d4675169-bf53-4661-9b39-01540c01f3d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28490 microversion: 2.20 time: 0.174285 Apr 21 14:40:52.660420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 123/252] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:52 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28490 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:40:53.070159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-52a943cf-8a4c-4184-9a18-37d035b2a9f2 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:53.072036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-52a943cf-8a4c-4184-9a18-37d035b2a9f2 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:53.096291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-52a943cf-8a4c-4184-9a18-37d035b2a9f2 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:53.099246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-52a943cf-8a4c-4184-9a18-37d035b2a9f2 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:53.100873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-52a943cf-8a4c-4184-9a18-37d035b2a9f2 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:53.102606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-52a943cf-8a4c-4184-9a18-37d035b2a9f2 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:53.231680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79b9cbc9-8764-4482-93ce-8be9e3f51df3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:53.243979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-79b9cbc9-8764-4482-93ce-8be9e3f51df3 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 1.184178 Apr 21 14:40:53.244646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 130/253] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:52 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:53.270678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e49af3f4-5c29-4ab6-b82c-1523002eafe2 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:53.271659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e49af3f4-5c29-4ab6-b82c-1523002eafe2 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:53.296042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e49af3f4-5c29-4ab6-b82c-1523002eafe2 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:53.296794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e49af3f4-5c29-4ab6-b82c-1523002eafe2 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:53.297840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e49af3f4-5c29-4ab6-b82c-1523002eafe2 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:53.298548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e49af3f4-5c29-4ab6-b82c-1523002eafe2 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:53.748236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-52a943cf-8a4c-4184-9a18-37d035b2a9f2 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:53.784608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-52a943cf-8a4c-4184-9a18-37d035b2a9f2 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1503 microversion: 2.1 time: 0.717570 Apr 21 14:40:53.803997 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 124/254] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:53 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1503 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:53.823451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c00834b1-5124-4568-a8a4-1a2b952a04dd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:53.826042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c00834b1-5124-4568-a8a4-1a2b952a04dd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:53.845346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c00834b1-5124-4568-a8a4-1a2b952a04dd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:53.846765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c00834b1-5124-4568-a8a4-1a2b952a04dd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:53.848785 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c00834b1-5124-4568-a8a4-1a2b952a04dd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:53.850108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c00834b1-5124-4568-a8a4-1a2b952a04dd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:54.042577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e49af3f4-5c29-4ab6-b82c-1523002eafe2 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:54.063206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e49af3f4-5c29-4ab6-b82c-1523002eafe2 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1315 microversion: 2.1 time: 0.803170 Apr 21 14:40:54.077872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 131/255] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:53 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:54.086802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-79620002-a71c-4267-8aa1-3c3c44bc4435 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:54.091691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-79620002-a71c-4267-8aa1-3c3c44bc4435 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:54.106552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c00834b1-5124-4568-a8a4-1a2b952a04dd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.299424 Apr 21 14:40:54.107652 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 125/256] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:53 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:54.117034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79620002-a71c-4267-8aa1-3c3c44bc4435 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:54.119734 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79620002-a71c-4267-8aa1-3c3c44bc4435 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:54.120827 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79620002-a71c-4267-8aa1-3c3c44bc4435 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:54.122243 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79620002-a71c-4267-8aa1-3c3c44bc4435 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:54.132088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-bc51cf75-7c8c-4fe3-948f-f7613595eaf6 req-d55f0666-e6f9-4544-855d-2de6110de2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2504706a-701f-4da9-90ec-425515785e61", "name": "network-vif-plugged", "status": "completed", "tag": "cc566d32-eb8b-44f2-807f-f7a1fae9c0f5"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:54.135907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:40:54.135907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:40:54.179088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bc51cf75-7c8c-4fe3-948f-f7613595eaf6 req-d55f0666-e6f9-4544-855d-2de6110de2d0 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:54.180235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bc51cf75-7c8c-4fe3-948f-f7613595eaf6 req-d55f0666-e6f9-4544-855d-2de6110de2d0 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:54.272569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-bc51cf75-7c8c-4fe3-948f-f7613595eaf6 req-d55f0666-e6f9-4544-855d-2de6110de2d0 service nova] Creating event network-vif-plugged:cc566d32-eb8b-44f2-807f-f7a1fae9c0f5 for instance 2504706a-701f-4da9-90ec-425515785e61 on hv-cinder-78638 Apr 21 14:40:54.295343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-bc51cf75-7c8c-4fe3-948f-f7613595eaf6 req-d55f0666-e6f9-4544-855d-2de6110de2d0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184605 Apr 21 14:40:54.297812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 126/257] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:54.336935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f2a9e19d-2663-4113-84aa-33361f018b96 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:54.339208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f2a9e19d-2663-4113-84aa-33361f018b96 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:54.363502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2a9e19d-2663-4113-84aa-33361f018b96 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:54.365128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2a9e19d-2663-4113-84aa-33361f018b96 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:54.368845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2a9e19d-2663-4113-84aa-33361f018b96 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:54.370525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2a9e19d-2663-4113-84aa-33361f018b96 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:54.841377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f2a9e19d-2663-4113-84aa-33361f018b96 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:54.856377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f2a9e19d-2663-4113-84aa-33361f018b96 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 0.554118 Apr 21 14:40:54.860987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 127/258] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:54 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:54.872908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-bd93acf4-f512-4f83-b988-4b1f056b7f7e req-861fbf6f-c079-4184-9f6f-b329a983ad83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ec6110-d4fc-47b0-98e2-3d3bbd9f277c", "tag": "bb2772ae-5550-452f-9ef9-fcef3de1a4f8"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:54.875887 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:40:54.875887 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:40:54.904390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bd93acf4-f512-4f83-b988-4b1f056b7f7e req-861fbf6f-c079-4184-9f6f-b329a983ad83 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:54.904909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bd93acf4-f512-4f83-b988-4b1f056b7f7e req-861fbf6f-c079-4184-9f6f-b329a983ad83 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:54.938207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-bd93acf4-f512-4f83-b988-4b1f056b7f7e req-861fbf6f-c079-4184-9f6f-b329a983ad83 service nova] Creating event network-changed:bb2772ae-5550-452f-9ef9-fcef3de1a4f8 for instance 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c on hv-cinder-78638 Apr 21 14:40:54.946516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-bd93acf4-f512-4f83-b988-4b1f056b7f7e req-861fbf6f-c079-4184-9f6f-b329a983ad83 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082842 Apr 21 14:40:54.947813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 128/259] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:40:55.014108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79620002-a71c-4267-8aa1-3c3c44bc4435 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:55.044766 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-79620002-a71c-4267-8aa1-3c3c44bc4435 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1515 microversion: 2.1 time: 0.964216 Apr 21 14:40:55.046736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 132/260] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:54 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1515 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:55.082710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-450d20de-f47a-4051-aa86-2b8c02871e0f tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:55.083551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-450d20de-f47a-4051-aa86-2b8c02871e0f tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:55.107684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-450d20de-f47a-4051-aa86-2b8c02871e0f tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:55.108203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-450d20de-f47a-4051-aa86-2b8c02871e0f tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:55.109092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-450d20de-f47a-4051-aa86-2b8c02871e0f tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:55.109589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-450d20de-f47a-4051-aa86-2b8c02871e0f tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:55.129933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-40516b4b-71b0-4ea0-b60b-0899fa394804 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:55.136641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-40516b4b-71b0-4ea0-b60b-0899fa394804 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:55.175901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40516b4b-71b0-4ea0-b60b-0899fa394804 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:55.179333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40516b4b-71b0-4ea0-b60b-0899fa394804 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:55.185043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40516b4b-71b0-4ea0-b60b-0899fa394804 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:55.186380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40516b4b-71b0-4ea0-b60b-0899fa394804 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:55.463314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-40516b4b-71b0-4ea0-b60b-0899fa394804 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.346002 Apr 21 14:40:55.464680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 133/261] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:55 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:55.877673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ee13b0e-2090-4204-8924-64b8f52e5b4d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:55.879106 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2ee13b0e-2090-4204-8924-64b8f52e5b4d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:55.904073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-450d20de-f47a-4051-aa86-2b8c02871e0f tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:55.912008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ee13b0e-2090-4204-8924-64b8f52e5b4d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:55.912550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ee13b0e-2090-4204-8924-64b8f52e5b4d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:55.913532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ee13b0e-2090-4204-8924-64b8f52e5b4d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:55.919873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ee13b0e-2090-4204-8924-64b8f52e5b4d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:55.948822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-450d20de-f47a-4051-aa86-2b8c02871e0f tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1315 microversion: 2.1 time: 0.870626 Apr 21 14:40:55.952890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 129/262] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:55 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1315 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:56.478488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2c012900-98df-4768-80b1-53c30c2a46d4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:56.479591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2c012900-98df-4768-80b1-53c30c2a46d4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:56.503927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c012900-98df-4768-80b1-53c30c2a46d4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:56.504441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c012900-98df-4768-80b1-53c30c2a46d4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:56.506159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c012900-98df-4768-80b1-53c30c2a46d4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:56.506661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c012900-98df-4768-80b1-53c30c2a46d4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:56.713212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2c012900-98df-4768-80b1-53c30c2a46d4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.238728 Apr 21 14:40:56.714016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 130/263] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:56 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:40:56.774812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ee13b0e-2090-4204-8924-64b8f52e5b4d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:56.795302 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ee13b0e-2090-4204-8924-64b8f52e5b4d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 0.923464 Apr 21 14:40:56.796350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 134/264] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:55 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:40:56.993428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d9623b6b-afe0-4dbc-8cf7-93832f292a34 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:57.000120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d9623b6b-afe0-4dbc-8cf7-93832f292a34 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:57.028979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9623b6b-afe0-4dbc-8cf7-93832f292a34 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:57.037180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9623b6b-afe0-4dbc-8cf7-93832f292a34 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:57.038542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9623b6b-afe0-4dbc-8cf7-93832f292a34 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:57.041354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9623b6b-afe0-4dbc-8cf7-93832f292a34 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:57.409462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d9623b6b-afe0-4dbc-8cf7-93832f292a34 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:57.422207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d9623b6b-afe0-4dbc-8cf7-93832f292a34 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1465 microversion: 2.1 time: 0.436952 Apr 21 14:40:57.423299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 131/265] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:56 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1465 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:57.477625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0cc11fd0-8c96-4051-8bb1-31d5d0eeb880 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:57.478956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0cc11fd0-8c96-4051-8bb1-31d5d0eeb880 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:57.511286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0cc11fd0-8c96-4051-8bb1-31d5d0eeb880 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:57.512129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0cc11fd0-8c96-4051-8bb1-31d5d0eeb880 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:57.515957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0cc11fd0-8c96-4051-8bb1-31d5d0eeb880 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:57.516750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0cc11fd0-8c96-4051-8bb1-31d5d0eeb880 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:57.598486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-30f1ab52-6cc6-4435-a75d-cad069179f46 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:57.600500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-30f1ab52-6cc6-4435-a75d-cad069179f46 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:57.629938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30f1ab52-6cc6-4435-a75d-cad069179f46 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:57.630863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30f1ab52-6cc6-4435-a75d-cad069179f46 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:57.631948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30f1ab52-6cc6-4435-a75d-cad069179f46 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:57.632605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30f1ab52-6cc6-4435-a75d-cad069179f46 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:57.739432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-30f1ab52-6cc6-4435-a75d-cad069179f46 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:40:57.793575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-0cc11fd0-8c96-4051-8bb1-31d5d0eeb880 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lazy-loading 'flavor' on Instance uuid 7218e5c2-90e5-4d93-94d8-3ac413a54fbb {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:40:58.083351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0cc11fd0-8c96-4051-8bb1-31d5d0eeb880 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/action" status: 200 len: 32 microversion: 2.1 time: 0.616905 Apr 21 14:40:58.089569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 135/266] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:40:57 2021] POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/action => generated 32 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 21 14:40:58.099732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4c75b95d-540b-4095-a2c6-391bfc989315 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:58.105897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4c75b95d-540b-4095-a2c6-391bfc989315 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:58.131317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c75b95d-540b-4095-a2c6-391bfc989315 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:58.131825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c75b95d-540b-4095-a2c6-391bfc989315 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:58.133974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c75b95d-540b-4095-a2c6-391bfc989315 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:58.134503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c75b95d-540b-4095-a2c6-391bfc989315 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:58.245768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-30f1ab52-6cc6-4435-a75d-cad069179f46 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 204 len: 0 microversion: 2.1 time: 0.653648 Apr 21 14:40:58.246497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 132/267] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:40:57 2021] DELETE /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:40:58.275451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3c22d9e7-7086-4b33-99d2-c5985cc8c026 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:58.276259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3c22d9e7-7086-4b33-99d2-c5985cc8c026 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:58.286691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c22d9e7-7086-4b33-99d2-c5985cc8c026 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:58.287209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c22d9e7-7086-4b33-99d2-c5985cc8c026 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:58.288074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c22d9e7-7086-4b33-99d2-c5985cc8c026 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:58.288641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c22d9e7-7086-4b33-99d2-c5985cc8c026 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:58.496871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4c75b95d-540b-4095-a2c6-391bfc989315 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.404902 Apr 21 14:40:58.501759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 136/268] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:58 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:40:58.507567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d3776f17-666e-4315-9c7a-04eb20278c29 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:58.509077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d3776f17-666e-4315-9c7a-04eb20278c29 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:58.524515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3776f17-666e-4315-9c7a-04eb20278c29 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:58.525659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3776f17-666e-4315-9c7a-04eb20278c29 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:58.527556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3776f17-666e-4315-9c7a-04eb20278c29 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:58.528756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3776f17-666e-4315-9c7a-04eb20278c29 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:58.907230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3c22d9e7-7086-4b33-99d2-c5985cc8c026 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:58.937783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3c22d9e7-7086-4b33-99d2-c5985cc8c026 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 0.671938 Apr 21 14:40:58.942443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 133/269] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:58 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:58.953816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7255e8d1-00b8-479e-a7a7-1498f698c5e3 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:58.972775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7255e8d1-00b8-479e-a7a7-1498f698c5e3 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:59.003941 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7255e8d1-00b8-479e-a7a7-1498f698c5e3 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:59.004471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7255e8d1-00b8-479e-a7a7-1498f698c5e3 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:59.005294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7255e8d1-00b8-479e-a7a7-1498f698c5e3 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:59.006150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7255e8d1-00b8-479e-a7a7-1498f698c5e3 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:59.455768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d3776f17-666e-4315-9c7a-04eb20278c29 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:59.468666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d3776f17-666e-4315-9c7a-04eb20278c29 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.969074 Apr 21 14:40:59.469319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 137/270] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:58 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:59.509843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab22ecc6-bac8-4d56-b5c8-833614cf6946 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:40:59.511102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ab22ecc6-bac8-4d56-b5c8-833614cf6946 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:59.531595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab22ecc6-bac8-4d56-b5c8-833614cf6946 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:59.532089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab22ecc6-bac8-4d56-b5c8-833614cf6946 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:59.543091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab22ecc6-bac8-4d56-b5c8-833614cf6946 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:59.543888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab22ecc6-bac8-4d56-b5c8-833614cf6946 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:59.719680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ab22ecc6-bac8-4d56-b5c8-833614cf6946 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.213839 Apr 21 14:40:59.720417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 138/271] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:40:59 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:40:59.786369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7255e8d1-00b8-479e-a7a7-1498f698c5e3 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:40:59.798751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7255e8d1-00b8-479e-a7a7-1498f698c5e3 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1471 microversion: 2.1 time: 0.854402 Apr 21 14:40:59.800019 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 134/272] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:58 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1471 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:40:59.964323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fc1c6387-e9bb-4dde-8d8e-605bff23d0bc tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:40:59.965658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fc1c6387-e9bb-4dde-8d8e-605bff23d0bc tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:40:59.988282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc1c6387-e9bb-4dde-8d8e-605bff23d0bc tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:59.988846 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc1c6387-e9bb-4dde-8d8e-605bff23d0bc tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:40:59.995616 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc1c6387-e9bb-4dde-8d8e-605bff23d0bc tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:40:59.996318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc1c6387-e9bb-4dde-8d8e-605bff23d0bc tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:00.355089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fc1c6387-e9bb-4dde-8d8e-605bff23d0bc tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:00.366067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fc1c6387-e9bb-4dde-8d8e-605bff23d0bc tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 0.408802 Apr 21 14:41:00.366772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 139/273] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:40:59 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:00.488101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9ca1a970-02d4-453c-9a1e-9314980c5f64 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:00.489187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9ca1a970-02d4-453c-9a1e-9314980c5f64 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:00.509461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ca1a970-02d4-453c-9a1e-9314980c5f64 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:00.510427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ca1a970-02d4-453c-9a1e-9314980c5f64 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:00.512165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ca1a970-02d4-453c-9a1e-9314980c5f64 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:00.512996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ca1a970-02d4-453c-9a1e-9314980c5f64 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:00.739129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-65dd070b-baff-4d98-90cd-9fc39815a303 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:00.740256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-65dd070b-baff-4d98-90cd-9fc39815a303 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:00.750696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65dd070b-baff-4d98-90cd-9fc39815a303 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:00.751205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65dd070b-baff-4d98-90cd-9fc39815a303 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:00.752077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65dd070b-baff-4d98-90cd-9fc39815a303 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:00.752755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65dd070b-baff-4d98-90cd-9fc39815a303 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:00.904298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-65dd070b-baff-4d98-90cd-9fc39815a303 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.174629 Apr 21 14:41:00.906894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 140/274] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:00 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:00.917658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f82da1cc-1b5f-454b-abf5-a0b1c1be069e tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:00.919505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f82da1cc-1b5f-454b-abf5-a0b1c1be069e tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:00.947068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f82da1cc-1b5f-454b-abf5-a0b1c1be069e tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:00.948269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f82da1cc-1b5f-454b-abf5-a0b1c1be069e tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:00.950197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f82da1cc-1b5f-454b-abf5-a0b1c1be069e tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:00.951242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f82da1cc-1b5f-454b-abf5-a0b1c1be069e tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:01.389396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f82da1cc-1b5f-454b-abf5-a0b1c1be069e tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:01.404090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f82da1cc-1b5f-454b-abf5-a0b1c1be069e tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1471 microversion: 2.1 time: 0.494990 Apr 21 14:41:01.404926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 141/275] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:00 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1471 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:01.411065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b5a4ff97-6965-4dab-89ef-af2adcdffb47 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:01.411896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b5a4ff97-6965-4dab-89ef-af2adcdffb47 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:01.420973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5a4ff97-6965-4dab-89ef-af2adcdffb47 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:01.421652 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5a4ff97-6965-4dab-89ef-af2adcdffb47 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:01.422697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5a4ff97-6965-4dab-89ef-af2adcdffb47 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:01.423299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5a4ff97-6965-4dab-89ef-af2adcdffb47 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:01.933233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5a4ff97-6965-4dab-89ef-af2adcdffb47 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:01.968691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b5a4ff97-6965-4dab-89ef-af2adcdffb47 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 0.562074 Apr 21 14:41:01.970185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 142/276] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:01 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:01.981359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f103875e-9393-485f-ae01-5e8bdb791b8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:01.984086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f103875e-9393-485f-ae01-5e8bdb791b8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:02.000917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f103875e-9393-485f-ae01-5e8bdb791b8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:02.002233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f103875e-9393-485f-ae01-5e8bdb791b8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:02.004177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f103875e-9393-485f-ae01-5e8bdb791b8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:02.005318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f103875e-9393-485f-ae01-5e8bdb791b8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:02.158698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9ca1a970-02d4-453c-9a1e-9314980c5f64 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:02.215595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9ca1a970-02d4-453c-9a1e-9314980c5f64 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 1.731622 Apr 21 14:41:02.216411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 135/277] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:00 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:02.221646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f103875e-9393-485f-ae01-5e8bdb791b8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.248208 Apr 21 14:41:02.224464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 143/278] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:01 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:02.442447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a666b9bc-4a41-4529-ad3e-705d0853a2fd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:02.445666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a666b9bc-4a41-4529-ad3e-705d0853a2fd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:02.471354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a666b9bc-4a41-4529-ad3e-705d0853a2fd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:02.472089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a666b9bc-4a41-4529-ad3e-705d0853a2fd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:02.473041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a666b9bc-4a41-4529-ad3e-705d0853a2fd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:02.473643 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a666b9bc-4a41-4529-ad3e-705d0853a2fd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:03.007982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fb82dafd-e5c3-429d-858e-eb2137211d3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:03.009258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fb82dafd-e5c3-429d-858e-eb2137211d3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:03.058751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb82dafd-e5c3-429d-858e-eb2137211d3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:03.059657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb82dafd-e5c3-429d-858e-eb2137211d3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:03.061207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb82dafd-e5c3-429d-858e-eb2137211d3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:03.071017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb82dafd-e5c3-429d-858e-eb2137211d3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:03.078825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a666b9bc-4a41-4529-ad3e-705d0853a2fd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:03.091922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a666b9bc-4a41-4529-ad3e-705d0853a2fd tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1471 microversion: 2.1 time: 0.657616 Apr 21 14:41:03.100658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 136/279] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:02 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1471 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:03.237448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-235041a6-0426-4dfe-a72d-c75355831fa3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:03.238295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-235041a6-0426-4dfe-a72d-c75355831fa3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:03.252271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-235041a6-0426-4dfe-a72d-c75355831fa3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:03.252752 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-235041a6-0426-4dfe-a72d-c75355831fa3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:03.255534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-235041a6-0426-4dfe-a72d-c75355831fa3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:03.258853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-235041a6-0426-4dfe-a72d-c75355831fa3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:03.633890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fb82dafd-e5c3-429d-858e-eb2137211d3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:03.669676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fb82dafd-e5c3-429d-858e-eb2137211d3a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 0.669947 Apr 21 14:41:03.671054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 144/280] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:02 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:03.693974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9fe896c7-3438-4301-ab79-c87af1faaf90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:03.697327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9fe896c7-3438-4301-ab79-c87af1faaf90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:03.724548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fe896c7-3438-4301-ab79-c87af1faaf90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:03.726343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fe896c7-3438-4301-ab79-c87af1faaf90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:03.727972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fe896c7-3438-4301-ab79-c87af1faaf90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:03.728936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fe896c7-3438-4301-ab79-c87af1faaf90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:03.819804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-235041a6-0426-4dfe-a72d-c75355831fa3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:03.846895 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-235041a6-0426-4dfe-a72d-c75355831fa3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.612985 Apr 21 14:41:03.856773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 137/281] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:03 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:03.870502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-ad24eb88-1f15-4ea0-96e8-ad6d3e6cc3dd req-c0ca3f26-c2aa-4af7-8120-de6a8b8a772d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2504706a-701f-4da9-90ec-425515785e61", "name": "network-vif-deleted", "tag": "cc566d32-eb8b-44f2-807f-f7a1fae9c0f5"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:03.883109 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:41:03.883109 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:41:03.899631 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ad24eb88-1f15-4ea0-96e8-ad6d3e6cc3dd req-c0ca3f26-c2aa-4af7-8120-de6a8b8a772d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:03.900650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ad24eb88-1f15-4ea0-96e8-ad6d3e6cc3dd req-c0ca3f26-c2aa-4af7-8120-de6a8b8a772d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:03.922999 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-ad24eb88-1f15-4ea0-96e8-ad6d3e6cc3dd req-c0ca3f26-c2aa-4af7-8120-de6a8b8a772d service nova] Creating event network-vif-deleted:cc566d32-eb8b-44f2-807f-f7a1fae9c0f5 for instance 2504706a-701f-4da9-90ec-425515785e61 on hv-cinder-78638 Apr 21 14:41:03.930667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-ad24eb88-1f15-4ea0-96e8-ad6d3e6cc3dd req-c0ca3f26-c2aa-4af7-8120-de6a8b8a772d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071879 Apr 21 14:41:03.932220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 138/282] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:41:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:41:03.938110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9fe896c7-3438-4301-ab79-c87af1faaf90 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.263756 Apr 21 14:41:03.939413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 145/283] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:03 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:04.134458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:04.135242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:04.151966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:04.154487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:04.155665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:04.159007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:04.295453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:04.295974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:04.296497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lazy-loading 'fault' on Instance uuid 2504706a-701f-4da9-90ec-425515785e61 {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:41:04.481517 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62046f89a614d8a9abfb132be4328e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba090b5b640c4c62bc71d826adeba33c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:04.501718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7a571852-5076-4462-aa21-fa6b338c5d98 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 200 len: 1305 microversion: 2.1 time: 0.371786 Apr 21 14:41:04.502948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 139/284] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:04 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 1305 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:04.709751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d55ea5c6-e345-457b-b081-d3059dbd2d5e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:04.711305 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d55ea5c6-e345-457b-b081-d3059dbd2d5e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:04.729601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d55ea5c6-e345-457b-b081-d3059dbd2d5e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:04.730614 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d55ea5c6-e345-457b-b081-d3059dbd2d5e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:04.732185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d55ea5c6-e345-457b-b081-d3059dbd2d5e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:04.733390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d55ea5c6-e345-457b-b081-d3059dbd2d5e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:04.884458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-189fcb98-43a6-4888-8ed6-ab1d12dd6f8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:04.885124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-189fcb98-43a6-4888-8ed6-ab1d12dd6f8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:04.898163 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-189fcb98-43a6-4888-8ed6-ab1d12dd6f8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:04.898594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-189fcb98-43a6-4888-8ed6-ab1d12dd6f8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:04.905172 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-189fcb98-43a6-4888-8ed6-ab1d12dd6f8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:04.905673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-189fcb98-43a6-4888-8ed6-ab1d12dd6f8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:05.256068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-189fcb98-43a6-4888-8ed6-ab1d12dd6f8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:05.274391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-189fcb98-43a6-4888-8ed6-ab1d12dd6f8f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.394657 Apr 21 14:41:05.290072 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 140/285] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:04 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:05.290072 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2f00a826-0e6b-4ae6-9ad5-6bbd6e5cc5fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:05.290072 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2f00a826-0e6b-4ae6-9ad5-6bbd6e5cc5fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:05.304613 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f00a826-0e6b-4ae6-9ad5-6bbd6e5cc5fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:05.305541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f00a826-0e6b-4ae6-9ad5-6bbd6e5cc5fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:05.307169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f00a826-0e6b-4ae6-9ad5-6bbd6e5cc5fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:05.307728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d55ea5c6-e345-457b-b081-d3059dbd2d5e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:05.308283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f00a826-0e6b-4ae6-9ad5-6bbd6e5cc5fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:05.338392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d55ea5c6-e345-457b-b081-d3059dbd2d5e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 0.637266 Apr 21 14:41:05.339844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 146/286] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:04 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:05.500408 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2f00a826-0e6b-4ae6-9ad5-6bbd6e5cc5fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.221865 Apr 21 14:41:05.501165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 141/287] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:05 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:05.524279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6bb4b8de-8fa9-4f41-8611-65d6863e89f6 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:05.525148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6bb4b8de-8fa9-4f41-8611-65d6863e89f6 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] [instance: 2504706a-701f-4da9-90ec-425515785e61] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:05.541568 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bb4b8de-8fa9-4f41-8611-65d6863e89f6 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:05.542328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bb4b8de-8fa9-4f41-8611-65d6863e89f6 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:05.544024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bb4b8de-8fa9-4f41-8611-65d6863e89f6 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:05.544850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bb4b8de-8fa9-4f41-8611-65d6863e89f6 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:05.647059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-6bb4b8de-8fa9-4f41-8611-65d6863e89f6 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] HTTP exception thrown: Instance 2504706a-701f-4da9-90ec-425515785e61 could not be found. Apr 21 14:41:05.648522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6bb4b8de-8fa9-4f41-8611-65d6863e89f6 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] Returning 404 to user: Instance 2504706a-701f-4da9-90ec-425515785e61 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:41:05.649792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6bb4b8de-8fa9-4f41-8611-65d6863e89f6 tempest-VolumesNegativeTest-1258459744 tempest-VolumesNegativeTest-1258459744-project] 10.222.0.24 "GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61" status: 404 len: 111 microversion: 2.1 time: 0.132496 Apr 21 14:41:05.650652 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 147/288] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:05 2021] GET /compute/v2.1/servers/2504706a-701f-4da9-90ec-425515785e61 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 21 14:41:05.880110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1648341527", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "networks": [{"uuid": "f6d72d4c-beec-4b6c-85f1-88e6085aa9dd"}]}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:05.988922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] validate_networks() for [('f6d72d4c-beec-4b6c-85f1-88e6085aa9dd', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:41:06.122967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-9cec804b-37ba-46fd-905e-598c440406fa req-62b1e953-1bdd-4173-954d-b90bccc1f37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ec6110-d4fc-47b0-98e2-3d3bbd9f277c", "name": "network-vif-plugged", "status": "completed", "tag": "bb2772ae-5550-452f-9ef9-fcef3de1a4f8"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:06.124769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:41:06.124769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:41:06.146219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-9cec804b-37ba-46fd-905e-598c440406fa req-62b1e953-1bdd-4173-954d-b90bccc1f37d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:06.146737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-9cec804b-37ba-46fd-905e-598c440406fa req-62b1e953-1bdd-4173-954d-b90bccc1f37d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:06.204932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-9cec804b-37ba-46fd-905e-598c440406fa req-62b1e953-1bdd-4173-954d-b90bccc1f37d service nova] Creating event network-vif-plugged:bb2772ae-5550-452f-9ef9-fcef3de1a4f8 for instance 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c on hv-cinder-78638 Apr 21 14:41:06.220092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-9cec804b-37ba-46fd-905e-598c440406fa req-62b1e953-1bdd-4173-954d-b90bccc1f37d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101517 Apr 21 14:41:06.221597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 148/289] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:41:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:41:06.314187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-783bc37a-6ec3-401b-8c21-64c20a253c54 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:06.315200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-783bc37a-6ec3-401b-8c21-64c20a253c54 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:06.332817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-783bc37a-6ec3-401b-8c21-64c20a253c54 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:06.333429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-783bc37a-6ec3-401b-8c21-64c20a253c54 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:06.335115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-783bc37a-6ec3-401b-8c21-64c20a253c54 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:06.338006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-783bc37a-6ec3-401b-8c21-64c20a253c54 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:06.818735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-783bc37a-6ec3-401b-8c21-64c20a253c54 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:06.856097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-783bc37a-6ec3-401b-8c21-64c20a253c54 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.553885 Apr 21 14:41:06.874064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 149/290] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:06 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:06.890607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-25f65117-5ce4-4ee3-b127-4ab4ff2057ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:06.891581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-25f65117-5ce4-4ee3-b127-4ab4ff2057ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:06.913684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25f65117-5ce4-4ee3-b127-4ab4ff2057ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:06.915208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25f65117-5ce4-4ee3-b127-4ab4ff2057ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:06.916413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25f65117-5ce4-4ee3-b127-4ab4ff2057ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:06.917127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25f65117-5ce4-4ee3-b127-4ab4ff2057ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:07.136875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:41:07.137244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:41:07.137841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:41:07.138292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:41:07.139009 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:41:07.157204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:07.158112 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:07.159205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:07.159905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:07.202685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Getting quotas for project f1fe7acbedbc48509204223f35d7eba2. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:41:07.210628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Getting quotas for user a3d29a86cf6f4ce3ac435e37a40d2396 and project f1fe7acbedbc48509204223f35d7eba2. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:41:07.227131 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:41:07.230589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:41:07.290657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-25f65117-5ce4-4ee3-b127-4ab4ff2057ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:07.291016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2e73746c-289d-4e78-9cc8-0149cb8d2341 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420047 Apr 21 14:41:07.297579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 142/291] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:41:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:41:07.303733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bb227951-de36-43c8-852e-4273b0ce753a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:07.305627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bb227951-de36-43c8-852e-4273b0ce753a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:07.305761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-25f65117-5ce4-4ee3-b127-4ab4ff2057ef tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 0.434225 Apr 21 14:41:07.310111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 150/292] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:06 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:07.322449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6711246e-d854-4530-a9b5-a2d419b5b9ca tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:07.323260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6711246e-d854-4530-a9b5-a2d419b5b9ca tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:07.331635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb227951-de36-43c8-852e-4273b0ce753a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:07.332191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb227951-de36-43c8-852e-4273b0ce753a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:07.333085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb227951-de36-43c8-852e-4273b0ce753a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:07.333647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb227951-de36-43c8-852e-4273b0ce753a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:07.472376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bb227951-de36-43c8-852e-4273b0ce753a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.172299 Apr 21 14:41:07.474619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 143/293] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:07 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:07.523390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6711246e-d854-4530-a9b5-a2d419b5b9ca tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:07.544037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6711246e-d854-4530-a9b5-a2d419b5b9ca tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1214 microversion: 2.1 time: 0.231490 Apr 21 14:41:07.550835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 151/294] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:07 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1214 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:07.904229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-618e089c-d0a5-4ad5-9203-607dfc4a030d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:07.906989 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-618e089c-d0a5-4ad5-9203-607dfc4a030d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:07.929051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-618e089c-d0a5-4ad5-9203-607dfc4a030d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:07.930428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-618e089c-d0a5-4ad5-9203-607dfc4a030d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:07.935073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-618e089c-d0a5-4ad5-9203-607dfc4a030d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:07.936557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-618e089c-d0a5-4ad5-9203-607dfc4a030d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:08.344570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-df169806-18c1-4d54-b045-9f3b16cecd20 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:08.346654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-df169806-18c1-4d54-b045-9f3b16cecd20 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:08.365772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df169806-18c1-4d54-b045-9f3b16cecd20 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:08.366694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df169806-18c1-4d54-b045-9f3b16cecd20 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:08.368745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df169806-18c1-4d54-b045-9f3b16cecd20 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:08.369980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df169806-18c1-4d54-b045-9f3b16cecd20 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:08.597917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-618e089c-d0a5-4ad5-9203-607dfc4a030d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:08.614735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-618e089c-d0a5-4ad5-9203-607dfc4a030d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.725668 Apr 21 14:41:08.615907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 144/295] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:07 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:08.624444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aecf0ac3-fa2a-4f77-a7ba-c17255726b97 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:08.626495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aecf0ac3-fa2a-4f77-a7ba-c17255726b97 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:08.640911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aecf0ac3-fa2a-4f77-a7ba-c17255726b97 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:08.641667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aecf0ac3-fa2a-4f77-a7ba-c17255726b97 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:08.642964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aecf0ac3-fa2a-4f77-a7ba-c17255726b97 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:08.643669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aecf0ac3-fa2a-4f77-a7ba-c17255726b97 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:08.855813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-df169806-18c1-4d54-b045-9f3b16cecd20 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:08.896891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aecf0ac3-fa2a-4f77-a7ba-c17255726b97 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.278503 Apr 21 14:41:08.906048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 145/296] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:08 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:08.916403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0f74b6d4-f1a8-42c6-92ef-32c799e8e323 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:08.917585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0f74b6d4-f1a8-42c6-92ef-32c799e8e323 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:08.920705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-df169806-18c1-4d54-b045-9f3b16cecd20 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1318 microversion: 2.1 time: 0.594818 Apr 21 14:41:08.927366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 152/297] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:08 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:08.933099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f74b6d4-f1a8-42c6-92ef-32c799e8e323 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:08.933621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f74b6d4-f1a8-42c6-92ef-32c799e8e323 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:08.934650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f74b6d4-f1a8-42c6-92ef-32c799e8e323 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:08.935600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f74b6d4-f1a8-42c6-92ef-32c799e8e323 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:09.154600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0f74b6d4-f1a8-42c6-92ef-32c799e8e323 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:09.165738 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0f74b6d4-f1a8-42c6-92ef-32c799e8e323 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1266 microversion: 2.1 time: 0.257678 Apr 21 14:41:09.166518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 146/298] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:08 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:09.637514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-71c9d7a9-a2f4-4411-aafb-00c9332da9e7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:09.638217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-71c9d7a9-a2f4-4411-aafb-00c9332da9e7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:09.655298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71c9d7a9-a2f4-4411-aafb-00c9332da9e7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:09.658794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71c9d7a9-a2f4-4411-aafb-00c9332da9e7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:09.659894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71c9d7a9-a2f4-4411-aafb-00c9332da9e7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:09.660613 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71c9d7a9-a2f4-4411-aafb-00c9332da9e7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:09.925962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb91341c-4ff3-46a4-8f85-fefb7da198f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:09.942308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb91341c-4ff3-46a4-8f85-fefb7da198f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:09.995612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb91341c-4ff3-46a4-8f85-fefb7da198f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:10.003335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb91341c-4ff3-46a4-8f85-fefb7da198f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:10.011987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb91341c-4ff3-46a4-8f85-fefb7da198f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:10.013220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb91341c-4ff3-46a4-8f85-fefb7da198f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:10.395800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb91341c-4ff3-46a4-8f85-fefb7da198f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.477618 Apr 21 14:41:10.396561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 147/299] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:09 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:10.403538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5a591672-56ab-45f5-aeb5-280ecc82b587 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:10.404258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5a591672-56ab-45f5-aeb5-280ecc82b587 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:10.426840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a591672-56ab-45f5-aeb5-280ecc82b587 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:10.431423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a591672-56ab-45f5-aeb5-280ecc82b587 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:10.432298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a591672-56ab-45f5-aeb5-280ecc82b587 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:10.432782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a591672-56ab-45f5-aeb5-280ecc82b587 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:10.512466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-71c9d7a9-a2f4-4411-aafb-00c9332da9e7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:10.531050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-71c9d7a9-a2f4-4411-aafb-00c9332da9e7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.901737 Apr 21 14:41:10.535194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 153/300] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:09 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:10.540610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-57995002-e857-4d64-be7d-b5371572965e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:10.563052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-57995002-e857-4d64-be7d-b5371572965e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:10.582725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57995002-e857-4d64-be7d-b5371572965e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:10.591783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57995002-e857-4d64-be7d-b5371572965e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:10.599032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57995002-e857-4d64-be7d-b5371572965e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:10.599762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57995002-e857-4d64-be7d-b5371572965e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:10.806418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-57995002-e857-4d64-be7d-b5371572965e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:10.820966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-57995002-e857-4d64-be7d-b5371572965e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1272 microversion: 2.1 time: 0.284312 Apr 21 14:41:10.821624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 154/301] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:10 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:11.424024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ca218397-3f78-4506-a967-b74b7f74b5e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:11.426762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ca218397-3f78-4506-a967-b74b7f74b5e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:11.480916 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca218397-3f78-4506-a967-b74b7f74b5e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:11.481838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca218397-3f78-4506-a967-b74b7f74b5e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:11.483415 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca218397-3f78-4506-a967-b74b7f74b5e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:11.484307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca218397-3f78-4506-a967-b74b7f74b5e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:11.660604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5a591672-56ab-45f5-aeb5-280ecc82b587 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:11.674123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5a591672-56ab-45f5-aeb5-280ecc82b587 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1508 microversion: 2.1 time: 1.276103 Apr 21 14:41:11.675245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 148/302] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:10 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1508 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:11.680981 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7636d14c-2514-438c-9b29-d013a6847b63 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:11.681860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7636d14c-2514-438c-9b29-d013a6847b63 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:11.691367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7636d14c-2514-438c-9b29-d013a6847b63 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:11.692079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7636d14c-2514-438c-9b29-d013a6847b63 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:11.693124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7636d14c-2514-438c-9b29-d013a6847b63 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:11.693776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7636d14c-2514-438c-9b29-d013a6847b63 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:11.704902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ca218397-3f78-4506-a967-b74b7f74b5e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.290693 Apr 21 14:41:11.712666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 155/303] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:11 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:11.841236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6daf602c-d88a-4a7a-b54c-95e71bdc9ffd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:11.842179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6daf602c-d88a-4a7a-b54c-95e71bdc9ffd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:11.862164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6daf602c-d88a-4a7a-b54c-95e71bdc9ffd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:11.862775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6daf602c-d88a-4a7a-b54c-95e71bdc9ffd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:11.863743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6daf602c-d88a-4a7a-b54c-95e71bdc9ffd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:11.865148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6daf602c-d88a-4a7a-b54c-95e71bdc9ffd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:12.400492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6daf602c-d88a-4a7a-b54c-95e71bdc9ffd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:12.412086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6daf602c-d88a-4a7a-b54c-95e71bdc9ffd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.576036 Apr 21 14:41:12.413619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 156/304] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:11 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:12.510628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7636d14c-2514-438c-9b29-d013a6847b63 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:12.524303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7636d14c-2514-438c-9b29-d013a6847b63 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.847411 Apr 21 14:41:12.525296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 149/305] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:11 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:12.722735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-533387db-4c10-4c41-80d2-7acef4619920 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:12.724196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-533387db-4c10-4c41-80d2-7acef4619920 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:12.743147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-533387db-4c10-4c41-80d2-7acef4619920 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:12.750124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-533387db-4c10-4c41-80d2-7acef4619920 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:12.755477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-533387db-4c10-4c41-80d2-7acef4619920 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:12.757690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-533387db-4c10-4c41-80d2-7acef4619920 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:12.915505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-533387db-4c10-4c41-80d2-7acef4619920 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.197509 Apr 21 14:41:12.916944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 157/306] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:12 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:13.446339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e1f99944-cef2-466a-968d-95f99d48e080 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:13.451713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e1f99944-cef2-466a-968d-95f99d48e080 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:13.482580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1f99944-cef2-466a-968d-95f99d48e080 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:13.483090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1f99944-cef2-466a-968d-95f99d48e080 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:13.489428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1f99944-cef2-466a-968d-95f99d48e080 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:13.490014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1f99944-cef2-466a-968d-95f99d48e080 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:13.565301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1419ed09-fd3f-420b-bbee-e266123da8a1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:13.567331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1419ed09-fd3f-420b-bbee-e266123da8a1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:13.590312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1419ed09-fd3f-420b-bbee-e266123da8a1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:13.593112 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1419ed09-fd3f-420b-bbee-e266123da8a1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:13.595433 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1419ed09-fd3f-420b-bbee-e266123da8a1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:13.596948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1419ed09-fd3f-420b-bbee-e266123da8a1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:14.224203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1419ed09-fd3f-420b-bbee-e266123da8a1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:14.236939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1419ed09-fd3f-420b-bbee-e266123da8a1 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.686985 Apr 21 14:41:14.250013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1f99944-cef2-466a-968d-95f99d48e080 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:14.251047 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 158/307] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:13 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:14.257767 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ca2d8664-2537-490f-bd9d-ae074b2396de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:14.259315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ca2d8664-2537-490f-bd9d-ae074b2396de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:14.263173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e1f99944-cef2-466a-968d-95f99d48e080 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.824976 Apr 21 14:41:14.263839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 150/308] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:13 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:14.268915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca2d8664-2537-490f-bd9d-ae074b2396de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:14.269696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca2d8664-2537-490f-bd9d-ae074b2396de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:14.270791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca2d8664-2537-490f-bd9d-ae074b2396de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:14.271626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca2d8664-2537-490f-bd9d-ae074b2396de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:14.360475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-ac73af5e-c627-4672-90cb-0d58b39a79ad req-ab34fd2f-8b48-403e-826d-eeacd7f6dc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f7a6936-78ec-46ce-9e64-c65542d9bc90", "tag": "0d0879fe-1030-44d4-8683-214bce5da765"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:14.369839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:41:14.369839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:41:14.396745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ac73af5e-c627-4672-90cb-0d58b39a79ad req-ab34fd2f-8b48-403e-826d-eeacd7f6dc7d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:14.397545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ac73af5e-c627-4672-90cb-0d58b39a79ad req-ab34fd2f-8b48-403e-826d-eeacd7f6dc7d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:14.420008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-ac73af5e-c627-4672-90cb-0d58b39a79ad req-ab34fd2f-8b48-403e-826d-eeacd7f6dc7d service nova] Creating event network-changed:0d0879fe-1030-44d4-8683-214bce5da765 for instance 5f7a6936-78ec-46ce-9e64-c65542d9bc90 on hv-cinder-78638 Apr 21 14:41:14.423988 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ca2d8664-2537-490f-bd9d-ae074b2396de tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.171191 Apr 21 14:41:14.426247 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 159/309] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:14 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:14.427353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-ac73af5e-c627-4672-90cb-0d58b39a79ad req-ab34fd2f-8b48-403e-826d-eeacd7f6dc7d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081386 Apr 21 14:41:14.428405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 151/310] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:41:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:41:15.264636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c78c6705-4a5c-4839-a620-718760acb205 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:15.266531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c78c6705-4a5c-4839-a620-718760acb205 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:15.286459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c78c6705-4a5c-4839-a620-718760acb205 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:15.287287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c78c6705-4a5c-4839-a620-718760acb205 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:15.290204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c78c6705-4a5c-4839-a620-718760acb205 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:15.290924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c78c6705-4a5c-4839-a620-718760acb205 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:15.303161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-be167e70-fff8-4cc5-b4fd-e600a76b6997 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:15.305816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-be167e70-fff8-4cc5-b4fd-e600a76b6997 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:15.343493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be167e70-fff8-4cc5-b4fd-e600a76b6997 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:15.344212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be167e70-fff8-4cc5-b4fd-e600a76b6997 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:15.345205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be167e70-fff8-4cc5-b4fd-e600a76b6997 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:15.345828 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be167e70-fff8-4cc5-b4fd-e600a76b6997 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:15.662841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c78c6705-4a5c-4839-a620-718760acb205 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:15.674226 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c78c6705-4a5c-4839-a620-718760acb205 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.419270 Apr 21 14:41:15.676112 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 160/311] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:15 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:15.686905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-02ed87ce-e2d3-4145-adc5-09be2f90702d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f35ad2c3-8615-4624-9d4d-45da2c42b5b9"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:15.688770 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-02ed87ce-e2d3-4145-adc5-09be2f90702d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:15.700383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02ed87ce-e2d3-4145-adc5-09be2f90702d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:15.701561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02ed87ce-e2d3-4145-adc5-09be2f90702d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:15.703745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02ed87ce-e2d3-4145-adc5-09be2f90702d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:15.704506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02ed87ce-e2d3-4145-adc5-09be2f90702d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:15.928795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-be167e70-fff8-4cc5-b4fd-e600a76b6997 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:15.938222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-be167e70-fff8-4cc5-b4fd-e600a76b6997 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.645897 Apr 21 14:41:15.939091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 152/312] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:15 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:15.955072 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4700d5ea-7b66-4ebd-bff2-29ef814011d5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:15.956344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4700d5ea-7b66-4ebd-bff2-29ef814011d5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:15.965332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4700d5ea-7b66-4ebd-bff2-29ef814011d5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:15.966091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4700d5ea-7b66-4ebd-bff2-29ef814011d5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:15.967260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4700d5ea-7b66-4ebd-bff2-29ef814011d5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:15.967971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4700d5ea-7b66-4ebd-bff2-29ef814011d5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:16.137590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4700d5ea-7b66-4ebd-bff2-29ef814011d5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.186558 Apr 21 14:41:16.139312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 153/313] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:15 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:16.515923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-02ed87ce-e2d3-4145-adc5-09be2f90702d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "POST /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838083 Apr 21 14:41:16.517832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 161/314] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:41:15 2021] POST /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:41:16.700868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9f490f1a-bc79-4a38-839c-99c88a08f492 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:16.702707 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9f490f1a-bc79-4a38-839c-99c88a08f492 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:16.720000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f490f1a-bc79-4a38-839c-99c88a08f492 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:16.720854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f490f1a-bc79-4a38-839c-99c88a08f492 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:16.722492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f490f1a-bc79-4a38-839c-99c88a08f492 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:16.723773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f490f1a-bc79-4a38-839c-99c88a08f492 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:16.958890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ff2e3563-075c-485a-84e9-7ea5bcfb85cd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:16.960126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ff2e3563-075c-485a-84e9-7ea5bcfb85cd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:16.981620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff2e3563-075c-485a-84e9-7ea5bcfb85cd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.004469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff2e3563-075c-485a-84e9-7ea5bcfb85cd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:17.009633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff2e3563-075c-485a-84e9-7ea5bcfb85cd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.012493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff2e3563-075c-485a-84e9-7ea5bcfb85cd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:17.090438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f490f1a-bc79-4a38-839c-99c88a08f492 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:17.101192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9f490f1a-bc79-4a38-839c-99c88a08f492 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1501 microversion: 2.1 time: 0.410252 Apr 21 14:41:17.114716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 154/315] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:16 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:17.120871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3b9efe95-7be9-4065-af6f-d41732afa88b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0975808-e9da-4b21-8d17-e8b2be7cc064"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:17.123703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3b9efe95-7be9-4065-af6f-d41732afa88b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:17.134334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b9efe95-7be9-4065-af6f-d41732afa88b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.135260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b9efe95-7be9-4065-af6f-d41732afa88b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:17.136388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b9efe95-7be9-4065-af6f-d41732afa88b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.137409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b9efe95-7be9-4065-af6f-d41732afa88b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:17.227982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-3b9efe95-7be9-4065-af6f-d41732afa88b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] HTTP exception thrown: Cannot 'attach_volume' instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb while it is in vm_state rescued Apr 21 14:41:17.229126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3b9efe95-7be9-4065-af6f-d41732afa88b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Returning 409 to user: Cannot 'attach_volume' instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb while it is in vm_state rescued {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:41:17.230279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3b9efe95-7be9-4065-af6f-d41732afa88b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.114177 Apr 21 14:41:17.231100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 155/316] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:41:17 2021] POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/os-volume_attachments => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 21 14:41:17.246622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1e458a7e-1403-49ef-9ffa-ee18551761ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:17.249671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1e458a7e-1403-49ef-9ffa-ee18551761ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:17.271311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e458a7e-1403-49ef-9ffa-ee18551761ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.272706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e458a7e-1403-49ef-9ffa-ee18551761ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:17.274638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e458a7e-1403-49ef-9ffa-ee18551761ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.275786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e458a7e-1403-49ef-9ffa-ee18551761ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:17.445140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ff2e3563-075c-485a-84e9-7ea5bcfb85cd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:17.454010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ff2e3563-075c-485a-84e9-7ea5bcfb85cd tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.500455 Apr 21 14:41:17.454742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 162/317] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:16 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:17.474954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c1df6b8c-265d-4454-a086-69f34188bfe6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:17.474954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c1df6b8c-265d-4454-a086-69f34188bfe6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:17.474954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1df6b8c-265d-4454-a086-69f34188bfe6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.474954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1df6b8c-265d-4454-a086-69f34188bfe6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:17.475667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1df6b8c-265d-4454-a086-69f34188bfe6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.475667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1df6b8c-265d-4454-a086-69f34188bfe6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:17.475930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1e458a7e-1403-49ef-9ffa-ee18551761ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.241079 Apr 21 14:41:17.475930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 156/318] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:17 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:17.624844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c1df6b8c-265d-4454-a086-69f34188bfe6 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/action" status: 202 len: 0 microversion: 2.1 time: 0.168601 Apr 21 14:41:17.625543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 163/319] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:41:17 2021] POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:17.635514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-503fb0c6-5eea-4558-ad08-b5401c7e6b2b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:17.636399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-503fb0c6-5eea-4558-ad08-b5401c7e6b2b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:17.645706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-503fb0c6-5eea-4558-ad08-b5401c7e6b2b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.646220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-503fb0c6-5eea-4558-ad08-b5401c7e6b2b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:17.647231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-503fb0c6-5eea-4558-ad08-b5401c7e6b2b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:17.647723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-503fb0c6-5eea-4558-ad08-b5401c7e6b2b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:18.108831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-503fb0c6-5eea-4558-ad08-b5401c7e6b2b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:18.132006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-503fb0c6-5eea-4558-ad08-b5401c7e6b2b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1509 microversion: 2.1 time: 0.500701 Apr 21 14:41:18.134359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 157/320] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:17 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:18.492752 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5a9f8fe4-9163-4746-979c-4de5ac399fa1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:18.493574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5a9f8fe4-9163-4746-979c-4de5ac399fa1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:18.494403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dc2b6332-b686-43de-aaa4-6ba72ea92634 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:18.495599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dc2b6332-b686-43de-aaa4-6ba72ea92634 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:18.510601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a9f8fe4-9163-4746-979c-4de5ac399fa1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:18.515430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a9f8fe4-9163-4746-979c-4de5ac399fa1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:18.516317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a9f8fe4-9163-4746-979c-4de5ac399fa1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:18.516816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a9f8fe4-9163-4746-979c-4de5ac399fa1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:18.519421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc2b6332-b686-43de-aaa4-6ba72ea92634 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:18.519887 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc2b6332-b686-43de-aaa4-6ba72ea92634 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:18.520959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc2b6332-b686-43de-aaa4-6ba72ea92634 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:18.521443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc2b6332-b686-43de-aaa4-6ba72ea92634 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:18.644975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5a9f8fe4-9163-4746-979c-4de5ac399fa1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.156936 Apr 21 14:41:18.646450 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 158/321] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:18 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:18.912494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dc2b6332-b686-43de-aaa4-6ba72ea92634 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:18.924020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dc2b6332-b686-43de-aaa4-6ba72ea92634 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.442898 Apr 21 14:41:18.924896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 164/322] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:18 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:19.160253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-330a38a8-234f-4d3c-8455-6aa78d1a3938 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:19.163749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-330a38a8-234f-4d3c-8455-6aa78d1a3938 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:19.203417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-330a38a8-234f-4d3c-8455-6aa78d1a3938 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:19.204130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-330a38a8-234f-4d3c-8455-6aa78d1a3938 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:19.205806 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-330a38a8-234f-4d3c-8455-6aa78d1a3938 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:19.209024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-330a38a8-234f-4d3c-8455-6aa78d1a3938 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:19.590385 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-330a38a8-234f-4d3c-8455-6aa78d1a3938 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:19.600690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-330a38a8-234f-4d3c-8455-6aa78d1a3938 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1509 microversion: 2.1 time: 0.452156 Apr 21 14:41:19.601518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 159/323] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:19 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1509 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:19.660356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6de537d5-1e02-446d-9fb4-44f8c3f72dfe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:19.662287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6de537d5-1e02-446d-9fb4-44f8c3f72dfe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:19.673677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6de537d5-1e02-446d-9fb4-44f8c3f72dfe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:19.674586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6de537d5-1e02-446d-9fb4-44f8c3f72dfe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:19.676333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6de537d5-1e02-446d-9fb4-44f8c3f72dfe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:19.677036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6de537d5-1e02-446d-9fb4-44f8c3f72dfe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:19.820882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6de537d5-1e02-446d-9fb4-44f8c3f72dfe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.165945 Apr 21 14:41:19.822373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 165/324] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:19 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:19.945600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88765c2a-0daf-40e0-90d4-9f194e76549d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:19.946326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-88765c2a-0daf-40e0-90d4-9f194e76549d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:19.957229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88765c2a-0daf-40e0-90d4-9f194e76549d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:19.957823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88765c2a-0daf-40e0-90d4-9f194e76549d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:19.958948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88765c2a-0daf-40e0-90d4-9f194e76549d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:19.959632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88765c2a-0daf-40e0-90d4-9f194e76549d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:20.383801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88765c2a-0daf-40e0-90d4-9f194e76549d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:20.400307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88765c2a-0daf-40e0-90d4-9f194e76549d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.458590 Apr 21 14:41:20.414761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 160/325] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:19 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:20.622152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e6ed35b-516b-4764-bf8e-f9dabaf27444 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:20.622917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7e6ed35b-516b-4764-bf8e-f9dabaf27444 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:20.632614 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e6ed35b-516b-4764-bf8e-f9dabaf27444 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:20.633448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e6ed35b-516b-4764-bf8e-f9dabaf27444 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:20.634545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e6ed35b-516b-4764-bf8e-f9dabaf27444 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:20.635217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e6ed35b-516b-4764-bf8e-f9dabaf27444 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:20.836065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4d057814-2b19-4917-a7d5-8645a47b0814 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:20.837258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4d057814-2b19-4917-a7d5-8645a47b0814 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:20.859485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d057814-2b19-4917-a7d5-8645a47b0814 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:20.860033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d057814-2b19-4917-a7d5-8645a47b0814 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:20.867706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d057814-2b19-4917-a7d5-8645a47b0814 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:20.868343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d057814-2b19-4917-a7d5-8645a47b0814 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:21.010984 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7e6ed35b-516b-4764-bf8e-f9dabaf27444 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:21.025891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4d057814-2b19-4917-a7d5-8645a47b0814 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.194064 Apr 21 14:41:21.027286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 161/326] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:20 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:21.032409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7e6ed35b-516b-4764-bf8e-f9dabaf27444 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1509 microversion: 2.1 time: 0.414901 Apr 21 14:41:21.035637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 166/327] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:20 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:21.435209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e5cc5ef-fb11-4112-a3fb-90ac47ef033e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:21.437404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e5cc5ef-fb11-4112-a3fb-90ac47ef033e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:21.458150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5ef-fb11-4112-a3fb-90ac47ef033e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:21.459063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5ef-fb11-4112-a3fb-90ac47ef033e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:21.460310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5ef-fb11-4112-a3fb-90ac47ef033e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:21.461452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e5cc5ef-fb11-4112-a3fb-90ac47ef033e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:21.876626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8e5cc5ef-fb11-4112-a3fb-90ac47ef033e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:21.889374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e5cc5ef-fb11-4112-a3fb-90ac47ef033e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.463671 Apr 21 14:41:21.890478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 162/328] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:21 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:22.044006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e9f0699-491a-4bf2-97db-e2039edbcac5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:22.046840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7e9f0699-491a-4bf2-97db-e2039edbcac5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:22.062597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0c7f4640-8d02-4e85-8216-3cdd72e10beb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:22.062877 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e9f0699-491a-4bf2-97db-e2039edbcac5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:22.063584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e9f0699-491a-4bf2-97db-e2039edbcac5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:22.064913 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0c7f4640-8d02-4e85-8216-3cdd72e10beb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:22.065085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e9f0699-491a-4bf2-97db-e2039edbcac5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:22.065839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e9f0699-491a-4bf2-97db-e2039edbcac5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:22.081441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c7f4640-8d02-4e85-8216-3cdd72e10beb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:22.082910 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c7f4640-8d02-4e85-8216-3cdd72e10beb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:22.085313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c7f4640-8d02-4e85-8216-3cdd72e10beb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:22.086611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c7f4640-8d02-4e85-8216-3cdd72e10beb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:22.575127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0c7f4640-8d02-4e85-8216-3cdd72e10beb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:22.594064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0c7f4640-8d02-4e85-8216-3cdd72e10beb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1509 microversion: 2.1 time: 0.539129 Apr 21 14:41:22.595322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 163/329] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:22 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:22.926376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3ae153fe-bf1b-4001-a3b8-db3f99559126 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:22.930434 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3ae153fe-bf1b-4001-a3b8-db3f99559126 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:22.945129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ae153fe-bf1b-4001-a3b8-db3f99559126 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:22.945774 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ae153fe-bf1b-4001-a3b8-db3f99559126 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:22.946858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ae153fe-bf1b-4001-a3b8-db3f99559126 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:22.947503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ae153fe-bf1b-4001-a3b8-db3f99559126 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:23.410168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3ae153fe-bf1b-4001-a3b8-db3f99559126 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:23.423514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3ae153fe-bf1b-4001-a3b8-db3f99559126 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.507736 Apr 21 14:41:23.428467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 164/330] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:22 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:23.625559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-336b3d65-f1c7-45ce-ace4-3fcc883ec6b4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:23.627651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-336b3d65-f1c7-45ce-ace4-3fcc883ec6b4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:23.639866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-336b3d65-f1c7-45ce-ace4-3fcc883ec6b4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:23.640686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-336b3d65-f1c7-45ce-ace4-3fcc883ec6b4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:23.641816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-336b3d65-f1c7-45ce-ace4-3fcc883ec6b4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:23.642564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-336b3d65-f1c7-45ce-ace4-3fcc883ec6b4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:24.509172 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-336b3d65-f1c7-45ce-ace4-3fcc883ec6b4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:24.521510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-336b3d65-f1c7-45ce-ace4-3fcc883ec6b4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1509 microversion: 2.1 time: 0.907895 Apr 21 14:41:24.522610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 165/331] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:23 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1509 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:24.528283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fc3312c8-97c7-456f-88bf-f7007686a28b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:24.528959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fc3312c8-97c7-456f-88bf-f7007686a28b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:24.539677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc3312c8-97c7-456f-88bf-f7007686a28b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:24.540177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc3312c8-97c7-456f-88bf-f7007686a28b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:24.550199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc3312c8-97c7-456f-88bf-f7007686a28b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:24.551128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc3312c8-97c7-456f-88bf-f7007686a28b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:25.446432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fc3312c8-97c7-456f-88bf-f7007686a28b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:25.457085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fc3312c8-97c7-456f-88bf-f7007686a28b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.933164 Apr 21 14:41:25.461231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 166/332] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:24 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:25.545657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a76f200a-83ba-42a4-8a4c-7c1ad513a417 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:25.546536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a76f200a-83ba-42a4-8a4c-7c1ad513a417 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:25.564958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a76f200a-83ba-42a4-8a4c-7c1ad513a417 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:25.566628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a76f200a-83ba-42a4-8a4c-7c1ad513a417 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:25.568495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a76f200a-83ba-42a4-8a4c-7c1ad513a417 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:25.570165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a76f200a-83ba-42a4-8a4c-7c1ad513a417 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:25.743353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7e9f0699-491a-4bf2-97db-e2039edbcac5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 3.705311 Apr 21 14:41:25.747837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 167/333] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:22 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 3707 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:26.158774 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a76f200a-83ba-42a4-8a4c-7c1ad513a417 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:26.172788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a76f200a-83ba-42a4-8a4c-7c1ad513a417 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1509 microversion: 2.1 time: 0.635760 Apr 21 14:41:26.173435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 167/334] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:25 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1509 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:26.497947 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6662e2fd-abff-48e3-b19e-2ca251c80f10 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:26.499386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6662e2fd-abff-48e3-b19e-2ca251c80f10 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:26.569286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6662e2fd-abff-48e3-b19e-2ca251c80f10 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:26.577630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6662e2fd-abff-48e3-b19e-2ca251c80f10 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:26.579189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6662e2fd-abff-48e3-b19e-2ca251c80f10 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:26.580307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6662e2fd-abff-48e3-b19e-2ca251c80f10 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:26.768301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc17ecc4-2c99-4c39-b55a-886e2c3a1f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:26.773581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc17ecc4-2c99-4c39-b55a-886e2c3a1f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:26.812946 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc17ecc4-2c99-4c39-b55a-886e2c3a1f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:26.815026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc17ecc4-2c99-4c39-b55a-886e2c3a1f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:26.820160 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc17ecc4-2c99-4c39-b55a-886e2c3a1f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:26.824397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc17ecc4-2c99-4c39-b55a-886e2c3a1f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:27.141219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc17ecc4-2c99-4c39-b55a-886e2c3a1f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.385736 Apr 21 14:41:27.143209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 168/335] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:26 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:41:27.208157 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d2ccfc7d-c616-4239-9eaa-9ed54a6ef305 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:27.214154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d2ccfc7d-c616-4239-9eaa-9ed54a6ef305 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:27.260189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2ccfc7d-c616-4239-9eaa-9ed54a6ef305 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:27.268307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2ccfc7d-c616-4239-9eaa-9ed54a6ef305 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:27.272840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2ccfc7d-c616-4239-9eaa-9ed54a6ef305 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:27.280081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2ccfc7d-c616-4239-9eaa-9ed54a6ef305 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:27.475971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6662e2fd-abff-48e3-b19e-2ca251c80f10 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:27.486731 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6662e2fd-abff-48e3-b19e-2ca251c80f10 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.998136 Apr 21 14:41:27.487386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 168/336] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:26 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:28.158476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b386f37d-fde7-4a08-8d3c-c3961ea7224c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:28.160260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b386f37d-fde7-4a08-8d3c-c3961ea7224c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:28.179758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b386f37d-fde7-4a08-8d3c-c3961ea7224c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:28.184593 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b386f37d-fde7-4a08-8d3c-c3961ea7224c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:28.186041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b386f37d-fde7-4a08-8d3c-c3961ea7224c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:28.186768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b386f37d-fde7-4a08-8d3c-c3961ea7224c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:28.274932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d2ccfc7d-c616-4239-9eaa-9ed54a6ef305 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:28.308115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d2ccfc7d-c616-4239-9eaa-9ed54a6ef305 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1515 microversion: 2.1 time: 1.108601 Apr 21 14:41:28.309167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 169/337] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:27 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1515 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:28.339081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-201952d8-c990-477d-bbd8-f414eafc947f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f35ad2c3-8615-4624-9d4d-45da2c42b5b9"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:28.341708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-201952d8-c990-477d-bbd8-f414eafc947f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:28.358387 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-201952d8-c990-477d-bbd8-f414eafc947f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:28.360437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-201952d8-c990-477d-bbd8-f414eafc947f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:28.362419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-201952d8-c990-477d-bbd8-f414eafc947f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:28.363521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-201952d8-c990-477d-bbd8-f414eafc947f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:28.450820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b386f37d-fde7-4a08-8d3c-c3961ea7224c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.295718 Apr 21 14:41:28.459764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 169/338] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:28 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:41:28.511581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-599aa0c3-a310-4bca-8073-851e9e108181 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:28.524530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-599aa0c3-a310-4bca-8073-851e9e108181 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:28.564688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-599aa0c3-a310-4bca-8073-851e9e108181 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:28.566050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-599aa0c3-a310-4bca-8073-851e9e108181 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:28.576033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-599aa0c3-a310-4bca-8073-851e9e108181 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:28.577280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-599aa0c3-a310-4bca-8073-851e9e108181 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:29.039602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-201952d8-c990-477d-bbd8-f414eafc947f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] HTTP exception thrown: Invalid volume: volume f35ad2c3-8615-4624-9d4d-45da2c42b5b9 is already attached to instances: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c Apr 21 14:41:29.040311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-201952d8-c990-477d-bbd8-f414eafc947f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Returning 400 to user: Invalid volume: volume f35ad2c3-8615-4624-9d4d-45da2c42b5b9 is already attached to instances: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:41:29.041326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-201952d8-c990-477d-bbd8-f414eafc947f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "POST /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.723297 Apr 21 14:41:29.054931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 170/339] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:41:28 2021] POST /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c/os-volume_attachments => generated 174 bytes in 740 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:41:29.303173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-599aa0c3-a310-4bca-8073-851e9e108181 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:29.348213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-599aa0c3-a310-4bca-8073-851e9e108181 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.846124 Apr 21 14:41:29.349043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 170/340] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:28 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:29.475419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aa5a9c2e-fb69-4f71-b05d-32c212f99754 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:29.483310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aa5a9c2e-fb69-4f71-b05d-32c212f99754 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:29.516988 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa5a9c2e-fb69-4f71-b05d-32c212f99754 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:29.517443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa5a9c2e-fb69-4f71-b05d-32c212f99754 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:29.518278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa5a9c2e-fb69-4f71-b05d-32c212f99754 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:29.518768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa5a9c2e-fb69-4f71-b05d-32c212f99754 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:29.654161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-244a4e39-8426-49e7-b294-f1d40cfc6551 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:29.655603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-244a4e39-8426-49e7-b294-f1d40cfc6551 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:29.661360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aa5a9c2e-fb69-4f71-b05d-32c212f99754 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.195406 Apr 21 14:41:29.663254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 171/341] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:29 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:29.692682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-244a4e39-8426-49e7-b294-f1d40cfc6551 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:29.694473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-244a4e39-8426-49e7-b294-f1d40cfc6551 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:29.697253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-244a4e39-8426-49e7-b294-f1d40cfc6551 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:29.698533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-244a4e39-8426-49e7-b294-f1d40cfc6551 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:30.182577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-f575a7d7-9fc9-425d-9767-823ebc99d9e6 req-1da61f18-d8bb-4d13-aa64-90d3454b2f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7a6936-78ec-46ce-9e64-c65542d9bc90", "name": "network-vif-plugged", "status": "completed", "tag": "0d0879fe-1030-44d4-8683-214bce5da765"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:30.186133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:41:30.186133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:41:30.214447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f575a7d7-9fc9-425d-9767-823ebc99d9e6 req-1da61f18-d8bb-4d13-aa64-90d3454b2f25 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:30.217035 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f575a7d7-9fc9-425d-9767-823ebc99d9e6 req-1da61f18-d8bb-4d13-aa64-90d3454b2f25 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:30.264350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-f575a7d7-9fc9-425d-9767-823ebc99d9e6 req-1da61f18-d8bb-4d13-aa64-90d3454b2f25 service nova] Creating event network-vif-plugged:0d0879fe-1030-44d4-8683-214bce5da765 for instance 5f7a6936-78ec-46ce-9e64-c65542d9bc90 on hv-cinder-78638 Apr 21 14:41:30.278815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-f575a7d7-9fc9-425d-9767-823ebc99d9e6 req-1da61f18-d8bb-4d13-aa64-90d3454b2f25 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100634 Apr 21 14:41:30.280955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 172/342] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:41:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:41:30.383698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1be68f6e-c6b8-4666-bda4-f4fa18a770f6 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:30.385061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1be68f6e-c6b8-4666-bda4-f4fa18a770f6 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:30.408217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1be68f6e-c6b8-4666-bda4-f4fa18a770f6 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:30.414296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1be68f6e-c6b8-4666-bda4-f4fa18a770f6 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:30.416822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1be68f6e-c6b8-4666-bda4-f4fa18a770f6 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:30.417329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1be68f6e-c6b8-4666-bda4-f4fa18a770f6 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:30.495130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-244a4e39-8426-49e7-b294-f1d40cfc6551 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lazy-loading 'services' on Instance uuid 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:41:30.882576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-244a4e39-8426-49e7-b294-f1d40cfc6551 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c/os-volume_attachments/f35ad2c3-8615-4624-9d4d-45da2c42b5b9" status: 202 len: 0 microversion: 2.1 time: 1.236105 Apr 21 14:41:30.885466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 171/343] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:41:29 2021] DELETE /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c/os-volume_attachments/f35ad2c3-8615-4624-9d4d-45da2c42b5b9 => generated 0 bytes in 1241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:30.903108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-142aae27-2682-4127-8451-fd461bdfc86d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:30.906299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-142aae27-2682-4127-8451-fd461bdfc86d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:30.919334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142aae27-2682-4127-8451-fd461bdfc86d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:30.922039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142aae27-2682-4127-8451-fd461bdfc86d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:30.923313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142aae27-2682-4127-8451-fd461bdfc86d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:30.924038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142aae27-2682-4127-8451-fd461bdfc86d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:31.079209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-142aae27-2682-4127-8451-fd461bdfc86d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.191050 Apr 21 14:41:31.086321 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 172/344] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:30 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:31.303958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-96278df7-0b9d-4cc2-8594-fe1bbce1db26 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:31.304929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-96278df7-0b9d-4cc2-8594-fe1bbce1db26 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:31.316168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96278df7-0b9d-4cc2-8594-fe1bbce1db26 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:31.317858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96278df7-0b9d-4cc2-8594-fe1bbce1db26 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:31.319022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96278df7-0b9d-4cc2-8594-fe1bbce1db26 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:31.319651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96278df7-0b9d-4cc2-8594-fe1bbce1db26 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:31.343538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1be68f6e-c6b8-4666-bda4-f4fa18a770f6 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:31.357511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1be68f6e-c6b8-4666-bda4-f4fa18a770f6 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.979990 Apr 21 14:41:31.374018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 173/345] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:30 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:31.739949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-96278df7-0b9d-4cc2-8594-fe1bbce1db26 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:31.756886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-96278df7-0b9d-4cc2-8594-fe1bbce1db26 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1515 microversion: 2.1 time: 0.458082 Apr 21 14:41:31.758223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 173/346] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:31 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1515 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:31.776867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc5c0456-fb80-41d7-8964-4946f6547806 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "984a3c51-dad4-4a91-acdf-f97041b6ed12"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:31.778465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc5c0456-fb80-41d7-8964-4946f6547806 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:31.792248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc5c0456-fb80-41d7-8964-4946f6547806 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:31.793099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc5c0456-fb80-41d7-8964-4946f6547806 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:31.794275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc5c0456-fb80-41d7-8964-4946f6547806 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:31.794944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc5c0456-fb80-41d7-8964-4946f6547806 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:32.093861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f5f24362-fb42-4b10-83a0-58afa3115a88 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:32.095361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f5f24362-fb42-4b10-83a0-58afa3115a88 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:32.118624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5f24362-fb42-4b10-83a0-58afa3115a88 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:32.124347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5f24362-fb42-4b10-83a0-58afa3115a88 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:32.127852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5f24362-fb42-4b10-83a0-58afa3115a88 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:32.129926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5f24362-fb42-4b10-83a0-58afa3115a88 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:32.468553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f5f24362-fb42-4b10-83a0-58afa3115a88 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.378334 Apr 21 14:41:32.470712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 174/347] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:32 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:32.496534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-37ee0939-a203-4ad8-ba5a-fe27cfa9c64b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:32.498377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-37ee0939-a203-4ad8-ba5a-fe27cfa9c64b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:32.530101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37ee0939-a203-4ad8-ba5a-fe27cfa9c64b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:32.543840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37ee0939-a203-4ad8-ba5a-fe27cfa9c64b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:32.545772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37ee0939-a203-4ad8-ba5a-fe27cfa9c64b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:32.551439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37ee0939-a203-4ad8-ba5a-fe27cfa9c64b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:32.975821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-37ee0939-a203-4ad8-ba5a-fe27cfa9c64b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:32.995330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-37ee0939-a203-4ad8-ba5a-fe27cfa9c64b tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1314 microversion: 2.1 time: 0.521863 Apr 21 14:41:32.996548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 175/348] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:32 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:33.044828 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc5c0456-fb80-41d7-8964-4946f6547806 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.271352 Apr 21 14:41:33.046014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 174/349] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:41:31 2021] POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/os-volume_attachments => generated 194 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:41:33.490249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4b1d0862-f45f-4f9e-b43b-bd5bea4e53ae tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:33.498927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4b1d0862-f45f-4f9e-b43b-bd5bea4e53ae tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:33.539473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b1d0862-f45f-4f9e-b43b-bd5bea4e53ae tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:33.549060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b1d0862-f45f-4f9e-b43b-bd5bea4e53ae tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:33.556756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b1d0862-f45f-4f9e-b43b-bd5bea4e53ae tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:33.558069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b1d0862-f45f-4f9e-b43b-bd5bea4e53ae tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:33.816688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4b1d0862-f45f-4f9e-b43b-bd5bea4e53ae tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.338503 Apr 21 14:41:33.822256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 176/350] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:33 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:34.030691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5e54318a-628f-47c6-831e-c10f7bc5d5d8 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:34.039163 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5e54318a-628f-47c6-831e-c10f7bc5d5d8 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:34.101972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e54318a-628f-47c6-831e-c10f7bc5d5d8 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:34.110987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e54318a-628f-47c6-831e-c10f7bc5d5d8 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:34.113194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e54318a-628f-47c6-831e-c10f7bc5d5d8 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:34.117921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e54318a-628f-47c6-831e-c10f7bc5d5d8 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:34.188323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2073918755", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "networks": [{"uuid": "d7586439-5692-45b4-a121-4de98b0d3272"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:34.409950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] validate_networks() for [('d7586439-5692-45b4-a121-4de98b0d3272', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:41:34.762458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5e54318a-628f-47c6-831e-c10f7bc5d5d8 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:34.779676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5e54318a-628f-47c6-831e-c10f7bc5d5d8 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1497 microversion: 2.1 time: 0.759133 Apr 21 14:41:34.794548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 175/351] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:34 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1497 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:34.836315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fa4aa1f0-c239-4b67-b6e4-9fd1ed642052 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:34.840786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fa4aa1f0-c239-4b67-b6e4-9fd1ed642052 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:34.866903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa4aa1f0-c239-4b67-b6e4-9fd1ed642052 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:34.875521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa4aa1f0-c239-4b67-b6e4-9fd1ed642052 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:34.879906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa4aa1f0-c239-4b67-b6e4-9fd1ed642052 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:34.880689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa4aa1f0-c239-4b67-b6e4-9fd1ed642052 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:35.071146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fa4aa1f0-c239-4b67-b6e4-9fd1ed642052 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.244297 Apr 21 14:41:35.071884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 176/352] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:34 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:41:36.085940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a7d5d2f6-cd46-4a78-954e-12bda48f503e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:36.087163 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a7d5d2f6-cd46-4a78-954e-12bda48f503e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:36.106641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a7d5d2f6-cd46-4a78-954e-12bda48f503e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:36.107463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a7d5d2f6-cd46-4a78-954e-12bda48f503e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:36.109653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a7d5d2f6-cd46-4a78-954e-12bda48f503e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:36.112155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a7d5d2f6-cd46-4a78-954e-12bda48f503e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:36.183350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:41:36.184249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:41:36.185041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:41:36.185922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:41:36.186608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:41:36.205202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:36.206075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:36.213311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:36.214443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:36.245541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Getting quotas for project c273beec5c4c4f89a4c7c896497de7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:41:36.251167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Getting quotas for user fc4c490791d14d0981977c2544a8f9c5 and project c273beec5c4c4f89a4c7c896497de7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:41:36.265592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:41:36.269074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:41:36.287359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a7d5d2f6-cd46-4a78-954e-12bda48f503e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.206201 Apr 21 14:41:36.288532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 177/353] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:36 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:36.343359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9608d2ce-f9bc-4e1f-a500-91c36d9e55d1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.170937 Apr 21 14:41:36.350377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 177/354] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:41:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:41:36.367790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a9a1e210-1666-4a0a-a167-079480be6a26 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:36.369812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a9a1e210-1666-4a0a-a167-079480be6a26 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:36.529732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a9a1e210-1666-4a0a-a167-079480be6a26 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:36.544164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a9a1e210-1666-4a0a-a167-079480be6a26 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1218 microversion: 2.1 time: 0.188765 Apr 21 14:41:36.556896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 178/355] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:36 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1218 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:36.748743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1aa1b0fc-d91b-4b13-9155-3f85e91f810f tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:36.750424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1aa1b0fc-d91b-4b13-9155-3f85e91f810f tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:36.760310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1aa1b0fc-d91b-4b13-9155-3f85e91f810f tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:36.761211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1aa1b0fc-d91b-4b13-9155-3f85e91f810f tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:36.762934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1aa1b0fc-d91b-4b13-9155-3f85e91f810f tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:36.763705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1aa1b0fc-d91b-4b13-9155-3f85e91f810f tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:36.911712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1aa1b0fc-d91b-4b13-9155-3f85e91f810f tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:41:37.307902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-799a1842-2a80-4a31-aa88-e9863568cbd6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:37.328536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-799a1842-2a80-4a31-aa88-e9863568cbd6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:37.369380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1aa1b0fc-d91b-4b13-9155-3f85e91f810f tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 204 len: 0 microversion: 2.1 time: 0.620684 Apr 21 14:41:37.377011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-799a1842-2a80-4a31-aa88-e9863568cbd6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:37.377628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 178/356] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:41:36 2021] DELETE /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:41:37.382760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-799a1842-2a80-4a31-aa88-e9863568cbd6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:37.384807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-799a1842-2a80-4a31-aa88-e9863568cbd6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:37.386172 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-799a1842-2a80-4a31-aa88-e9863568cbd6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:37.392818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34969204-7bb8-439e-a362-0810ca81a397 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:37.399864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34969204-7bb8-439e-a362-0810ca81a397 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:37.424526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34969204-7bb8-439e-a362-0810ca81a397 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:37.425219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34969204-7bb8-439e-a362-0810ca81a397 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:37.428061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34969204-7bb8-439e-a362-0810ca81a397 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:37.450070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34969204-7bb8-439e-a362-0810ca81a397 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:37.702595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-799a1842-2a80-4a31-aa88-e9863568cbd6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.404842 Apr 21 14:41:37.703550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 179/357] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:37 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:41:37.715278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c0ba873-dc42-4545-b6c7-b32a713d27a8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:37.721512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9c0ba873-dc42-4545-b6c7-b32a713d27a8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:38.030425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9c0ba873-dc42-4545-b6c7-b32a713d27a8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:38.062588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c0ba873-dc42-4545-b6c7-b32a713d27a8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1218 microversion: 2.1 time: 0.351721 Apr 21 14:41:38.070290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 180/358] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:37 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1218 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:38.164958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-34969204-7bb8-439e-a362-0810ca81a397 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:38.207584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34969204-7bb8-439e-a362-0810ca81a397 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1503 microversion: 2.1 time: 0.822556 Apr 21 14:41:38.230561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 179/359] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:37 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1503 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:38.716591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e018e7af-d847-4689-8e5d-c9d82362caaf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:38.717639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e018e7af-d847-4689-8e5d-c9d82362caaf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:38.758113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e018e7af-d847-4689-8e5d-c9d82362caaf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:38.758628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e018e7af-d847-4689-8e5d-c9d82362caaf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:38.759492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e018e7af-d847-4689-8e5d-c9d82362caaf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:38.759982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e018e7af-d847-4689-8e5d-c9d82362caaf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:38.888445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e018e7af-d847-4689-8e5d-c9d82362caaf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.175986 Apr 21 14:41:38.894625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 181/360] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:38 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:39.095115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9d960c0e-8a1f-43d7-ab64-cdbdb623e3dd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:39.100425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9d960c0e-8a1f-43d7-ab64-cdbdb623e3dd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:39.137817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d960c0e-8a1f-43d7-ab64-cdbdb623e3dd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:39.140328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d960c0e-8a1f-43d7-ab64-cdbdb623e3dd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:39.147140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d960c0e-8a1f-43d7-ab64-cdbdb623e3dd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:39.148397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d960c0e-8a1f-43d7-ab64-cdbdb623e3dd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:39.238630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0ecb6817-edb1-4ab3-bc45-e2d395e1197d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:39.240259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0ecb6817-edb1-4ab3-bc45-e2d395e1197d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:39.271914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ecb6817-edb1-4ab3-bc45-e2d395e1197d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:39.272820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ecb6817-edb1-4ab3-bc45-e2d395e1197d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:39.274067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ecb6817-edb1-4ab3-bc45-e2d395e1197d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:39.274861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ecb6817-edb1-4ab3-bc45-e2d395e1197d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:39.865782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0ecb6817-edb1-4ab3-bc45-e2d395e1197d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:39.882189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0ecb6817-edb1-4ab3-bc45-e2d395e1197d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1503 microversion: 2.1 time: 0.648100 Apr 21 14:41:39.884876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 182/361] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:39 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1503 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:39.908993 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-290d3958-b84a-4889-82c9-c1bdb4560ca1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:39.923751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-290d3958-b84a-4889-82c9-c1bdb4560ca1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:39.960097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-290d3958-b84a-4889-82c9-c1bdb4560ca1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:39.961392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-290d3958-b84a-4889-82c9-c1bdb4560ca1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:39.976231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-290d3958-b84a-4889-82c9-c1bdb4560ca1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:39.977634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-290d3958-b84a-4889-82c9-c1bdb4560ca1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:40.146885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9d960c0e-8a1f-43d7-ab64-cdbdb623e3dd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:40.205580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9d960c0e-8a1f-43d7-ab64-cdbdb623e3dd tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1270 microversion: 2.1 time: 1.118278 Apr 21 14:41:40.206025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 180/362] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:39 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1270 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:40.311694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-290d3958-b84a-4889-82c9-c1bdb4560ca1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.411115 Apr 21 14:41:40.313076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 183/363] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:39 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:40.904132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-27fe0889-38ff-43d3-9b60-632e02e0ed3e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:40.906181 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-27fe0889-38ff-43d3-9b60-632e02e0ed3e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:40.934018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27fe0889-38ff-43d3-9b60-632e02e0ed3e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:40.934264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27fe0889-38ff-43d3-9b60-632e02e0ed3e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:40.935139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27fe0889-38ff-43d3-9b60-632e02e0ed3e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:40.937952 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27fe0889-38ff-43d3-9b60-632e02e0ed3e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:41.117667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-30359499-89e9-4d3b-9b9a-06994a285221 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:41.137297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-30359499-89e9-4d3b-9b9a-06994a285221 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:41.197377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30359499-89e9-4d3b-9b9a-06994a285221 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:41.214316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30359499-89e9-4d3b-9b9a-06994a285221 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:41.215630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30359499-89e9-4d3b-9b9a-06994a285221 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:41.216540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30359499-89e9-4d3b-9b9a-06994a285221 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:41.419339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-30359499-89e9-4d3b-9b9a-06994a285221 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lazy-loading 'flavor' on Instance uuid 7218e5c2-90e5-4d93-94d8-3ac413a54fbb {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:41:41.836414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-30359499-89e9-4d3b-9b9a-06994a285221 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/action" status: 200 len: 32 microversion: 2.1 time: 0.727891 Apr 21 14:41:41.841720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 184/364] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:41:41 2021] POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/action => generated 32 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:41:41.844456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-680825e3-20f6-4825-8fab-df23283ca486 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:41.845254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-680825e3-20f6-4825-8fab-df23283ca486 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:41.855790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-680825e3-20f6-4825-8fab-df23283ca486 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:41.856375 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-680825e3-20f6-4825-8fab-df23283ca486 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:41.857194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-680825e3-20f6-4825-8fab-df23283ca486 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:41.858466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-680825e3-20f6-4825-8fab-df23283ca486 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:42.079167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-680825e3-20f6-4825-8fab-df23283ca486 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:42.091227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-680825e3-20f6-4825-8fab-df23283ca486 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1276 microversion: 2.1 time: 0.252498 Apr 21 14:41:42.092514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 185/365] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:41 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1276 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:42.106569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5f8c2fcc-03c1-43a9-98d8-a04fbcf263fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:42.109725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5f8c2fcc-03c1-43a9-98d8-a04fbcf263fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:42.119786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f8c2fcc-03c1-43a9-98d8-a04fbcf263fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:42.120768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f8c2fcc-03c1-43a9-98d8-a04fbcf263fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:42.122492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f8c2fcc-03c1-43a9-98d8-a04fbcf263fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:42.123633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f8c2fcc-03c1-43a9-98d8-a04fbcf263fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:42.259784 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5f8c2fcc-03c1-43a9-98d8-a04fbcf263fc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.165233 Apr 21 14:41:42.260518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 186/366] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:42 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:42.271357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fded7833-48c9-42c0-acc3-1fd64fced034 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:42.273612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fded7833-48c9-42c0-acc3-1fd64fced034 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:42.301102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fded7833-48c9-42c0-acc3-1fd64fced034 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:42.301971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fded7833-48c9-42c0-acc3-1fd64fced034 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:42.303646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fded7833-48c9-42c0-acc3-1fd64fced034 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:42.304500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fded7833-48c9-42c0-acc3-1fd64fced034 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:42.339929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-27fe0889-38ff-43d3-9b60-632e02e0ed3e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:42.357805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-27fe0889-38ff-43d3-9b60-632e02e0ed3e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1503 microversion: 2.1 time: 1.460200 Apr 21 14:41:42.378038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 181/367] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:40 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1503 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:42.962783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fded7833-48c9-42c0-acc3-1fd64fced034 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:42.987315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fded7833-48c9-42c0-acc3-1fd64fced034 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.725085 Apr 21 14:41:43.009577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 187/368] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:42 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:43.125232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4df57628-a064-41e7-920c-ddba312b11f8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:43.132711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4df57628-a064-41e7-920c-ddba312b11f8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:43.156736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4df57628-a064-41e7-920c-ddba312b11f8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:43.158086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4df57628-a064-41e7-920c-ddba312b11f8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:43.160064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4df57628-a064-41e7-920c-ddba312b11f8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:43.161255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4df57628-a064-41e7-920c-ddba312b11f8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:43.276061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8633ce7e-0f16-4476-88b7-f95e80ac78b6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:43.280815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8633ce7e-0f16-4476-88b7-f95e80ac78b6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:43.300283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8633ce7e-0f16-4476-88b7-f95e80ac78b6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:43.303005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8633ce7e-0f16-4476-88b7-f95e80ac78b6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:43.304000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8633ce7e-0f16-4476-88b7-f95e80ac78b6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:43.304723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8633ce7e-0f16-4476-88b7-f95e80ac78b6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:43.507859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8633ce7e-0f16-4476-88b7-f95e80ac78b6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28658 microversion: 2.20 time: 0.238733 Apr 21 14:41:43.508616 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 188/369] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:43 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28658 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:41:43.518499 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2678fe43-3dfa-47fd-b8f0-4e8462092b35 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:43.519268 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2678fe43-3dfa-47fd-b8f0-4e8462092b35 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:43.528633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2678fe43-3dfa-47fd-b8f0-4e8462092b35 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:43.529153 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2678fe43-3dfa-47fd-b8f0-4e8462092b35 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:43.530071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2678fe43-3dfa-47fd-b8f0-4e8462092b35 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:43.530566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2678fe43-3dfa-47fd-b8f0-4e8462092b35 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:43.567420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4df57628-a064-41e7-920c-ddba312b11f8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:43.580618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4df57628-a064-41e7-920c-ddba312b11f8 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1276 microversion: 2.1 time: 0.473746 Apr 21 14:41:43.597407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 182/370] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:43 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1276 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:43.712450 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2678fe43-3dfa-47fd-b8f0-4e8462092b35 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:43.723701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2678fe43-3dfa-47fd-b8f0-4e8462092b35 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1461 microversion: 2.1 time: 0.209627 Apr 21 14:41:43.725808 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 189/371] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:43 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1461 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:43.835883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-e9692fe2-46f3-451b-af66-33c076d074cb req-f26855c8-e50d-47e3-aaa9-64d14733b998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7a6936-78ec-46ce-9e64-c65542d9bc90", "name": "network-vif-deleted", "tag": "0d0879fe-1030-44d4-8683-214bce5da765"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:43.839316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:41:43.839316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:41:43.856021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e9692fe2-46f3-451b-af66-33c076d074cb req-f26855c8-e50d-47e3-aaa9-64d14733b998 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:43.856744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e9692fe2-46f3-451b-af66-33c076d074cb req-f26855c8-e50d-47e3-aaa9-64d14733b998 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:43.895764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-e9692fe2-46f3-451b-af66-33c076d074cb req-f26855c8-e50d-47e3-aaa9-64d14733b998 service nova] Creating event network-vif-deleted:0d0879fe-1030-44d4-8683-214bce5da765 for instance 5f7a6936-78ec-46ce-9e64-c65542d9bc90 on hv-cinder-78638 Apr 21 14:41:43.907937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-e9692fe2-46f3-451b-af66-33c076d074cb req-f26855c8-e50d-47e3-aaa9-64d14733b998 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078063 Apr 21 14:41:43.909944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 183/372] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:41:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:41:44.017328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-766a26c6-f8a6-4e00-9490-7594b1e6584b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:44.018725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-766a26c6-f8a6-4e00-9490-7594b1e6584b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:44.027650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-766a26c6-f8a6-4e00-9490-7594b1e6584b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:44.028155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-766a26c6-f8a6-4e00-9490-7594b1e6584b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:44.029001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-766a26c6-f8a6-4e00-9490-7594b1e6584b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:44.029488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-766a26c6-f8a6-4e00-9490-7594b1e6584b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:44.433318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-766a26c6-f8a6-4e00-9490-7594b1e6584b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:44.445546 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-766a26c6-f8a6-4e00-9490-7594b1e6584b tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.432353 Apr 21 14:41:44.448479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 190/373] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:44 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:44.521562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1975fd5b-084d-480f-b484-1ce1620c51d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:44.522889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1975fd5b-084d-480f-b484-1ce1620c51d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:44.543110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1975fd5b-084d-480f-b484-1ce1620c51d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:44.544052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1975fd5b-084d-480f-b484-1ce1620c51d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:44.545684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1975fd5b-084d-480f-b484-1ce1620c51d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:44.546639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1975fd5b-084d-480f-b484-1ce1620c51d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:44.605215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-380ad614-fea0-403d-aab6-574fc326cda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:44.606182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-380ad614-fea0-403d-aab6-574fc326cda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:44.627968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-380ad614-fea0-403d-aab6-574fc326cda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:44.628600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-380ad614-fea0-403d-aab6-574fc326cda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:44.629706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-380ad614-fea0-403d-aab6-574fc326cda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:44.630324 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-380ad614-fea0-403d-aab6-574fc326cda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:44.760951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1975fd5b-084d-480f-b484-1ce1620c51d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 28994 microversion: 2.20 time: 0.243882 Apr 21 14:41:44.761610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 184/374] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:44 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 28994 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:41:44.767779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:44.768606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:44.778738 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:44.779255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:44.780133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:44.780626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:44.889814 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:44.890396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:44.890912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lazy-loading 'fault' on Instance uuid 5f7a6936-78ec-46ce-9e64-c65542d9bc90 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:41:44.940802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-380ad614-fea0-403d-aab6-574fc326cda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:44.950988 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-380ad614-fea0-403d-aab6-574fc326cda1 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.349840 Apr 21 14:41:44.951660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 191/375] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:44 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:45.282400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:45.303510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bf3453ac-a7f1-4e28-b9c9-099aac31dc4a tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 200 len: 1304 microversion: 2.1 time: 0.539852 Apr 21 14:41:45.305039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 185/376] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:44 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 1304 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:45.465223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-15b7d2e3-6776-4eda-8fc5-5c4235958bf9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:45.467146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-15b7d2e3-6776-4eda-8fc5-5c4235958bf9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:45.476423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15b7d2e3-6776-4eda-8fc5-5c4235958bf9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:45.477332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15b7d2e3-6776-4eda-8fc5-5c4235958bf9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:45.478463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15b7d2e3-6776-4eda-8fc5-5c4235958bf9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:45.479165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15b7d2e3-6776-4eda-8fc5-5c4235958bf9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:45.728027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-15b7d2e3-6776-4eda-8fc5-5c4235958bf9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:45.739722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-15b7d2e3-6776-4eda-8fc5-5c4235958bf9 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.278336 Apr 21 14:41:45.740791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 192/377] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:45 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:45.776094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e5713c82-cbe6-4d3f-a470-183fbbf49b81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:45.777190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e5713c82-cbe6-4d3f-a470-183fbbf49b81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:45.786272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5713c82-cbe6-4d3f-a470-183fbbf49b81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:45.786790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5713c82-cbe6-4d3f-a470-183fbbf49b81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:45.787702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5713c82-cbe6-4d3f-a470-183fbbf49b81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:45.788204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5713c82-cbe6-4d3f-a470-183fbbf49b81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:45.907149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e5713c82-cbe6-4d3f-a470-183fbbf49b81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 30194 microversion: 2.20 time: 0.134838 Apr 21 14:41:45.907935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 186/378] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:45 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 30194 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:41:45.974418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e8992e13-85af-4d77-8727-002f3fe0ef0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:45.976086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e8992e13-85af-4d77-8727-002f3fe0ef0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:45.994820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8992e13-85af-4d77-8727-002f3fe0ef0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:45.996179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8992e13-85af-4d77-8727-002f3fe0ef0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:45.997971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8992e13-85af-4d77-8727-002f3fe0ef0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:45.999249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8992e13-85af-4d77-8727-002f3fe0ef0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:46.334396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-424e3e76-a11c-4f49-a5ac-5921864ef503 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:46.335617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-424e3e76-a11c-4f49-a5ac-5921864ef503 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: 5f7a6936-78ec-46ce-9e64-c65542d9bc90] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:46.345955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-424e3e76-a11c-4f49-a5ac-5921864ef503 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:46.350620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-424e3e76-a11c-4f49-a5ac-5921864ef503 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:46.352026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-424e3e76-a11c-4f49-a5ac-5921864ef503 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:46.352833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-424e3e76-a11c-4f49-a5ac-5921864ef503 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:46.417458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-424e3e76-a11c-4f49-a5ac-5921864ef503 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] HTTP exception thrown: Instance 5f7a6936-78ec-46ce-9e64-c65542d9bc90 could not be found. Apr 21 14:41:46.418200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-424e3e76-a11c-4f49-a5ac-5921864ef503 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Returning 404 to user: Instance 5f7a6936-78ec-46ce-9e64-c65542d9bc90 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:41:46.419185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-424e3e76-a11c-4f49-a5ac-5921864ef503 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90" status: 404 len: 111 microversion: 2.1 time: 0.089726 Apr 21 14:41:46.419860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 187/379] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:46 2021] GET /compute/v2.1/servers/5f7a6936-78ec-46ce-9e64-c65542d9bc90 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 21 14:41:46.579336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e8992e13-85af-4d77-8727-002f3fe0ef0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:46.581503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-480893655", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "networks": [{"uuid": "f6d72d4c-beec-4b6c-85f1-88e6085aa9dd"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:46.596606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e8992e13-85af-4d77-8727-002f3fe0ef0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.629812 Apr 21 14:41:46.600523 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 193/380] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:45 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:46.680667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] validate_networks() for [('f6d72d4c-beec-4b6c-85f1-88e6085aa9dd', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:41:46.760375 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8857f4dd-d873-40b3-8032-7c0692ee7517 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:46.760375 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8857f4dd-d873-40b3-8032-7c0692ee7517 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:46.769579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8857f4dd-d873-40b3-8032-7c0692ee7517 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:46.770121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8857f4dd-d873-40b3-8032-7c0692ee7517 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:46.770992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8857f4dd-d873-40b3-8032-7c0692ee7517 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:46.771533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8857f4dd-d873-40b3-8032-7c0692ee7517 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:47.013657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8857f4dd-d873-40b3-8032-7c0692ee7517 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:47.022402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8857f4dd-d873-40b3-8032-7c0692ee7517 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.267107 Apr 21 14:41:47.023384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 194/381] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:46 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:47.029219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e813bf39-6427-47f3-a285-4bbcef4f78a0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:47.030339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e813bf39-6427-47f3-a285-4bbcef4f78a0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:47.039276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e813bf39-6427-47f3-a285-4bbcef4f78a0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:47.039780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e813bf39-6427-47f3-a285-4bbcef4f78a0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:47.040743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e813bf39-6427-47f3-a285-4bbcef4f78a0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:47.041235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e813bf39-6427-47f3-a285-4bbcef4f78a0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:47.166536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e813bf39-6427-47f3-a285-4bbcef4f78a0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 31539 microversion: 2.20 time: 0.139741 Apr 21 14:41:47.168611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 195/382] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:47 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 31539 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:47.625300 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-08d9e8a5-2c53-4142-831e-873e4be92873 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:47.626888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-08d9e8a5-2c53-4142-831e-873e4be92873 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:47.646747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-08d9e8a5-2c53-4142-831e-873e4be92873 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:47.647715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-08d9e8a5-2c53-4142-831e-873e4be92873 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:47.649342 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-08d9e8a5-2c53-4142-831e-873e4be92873 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:47.650392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-08d9e8a5-2c53-4142-831e-873e4be92873 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:48.092833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-08d9e8a5-2c53-4142-831e-873e4be92873 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:48.105625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-08d9e8a5-2c53-4142-831e-873e4be92873 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.490236 Apr 21 14:41:48.106491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 196/383] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:47 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:48.125456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-10f494f3-e4b3-4aee-a568-4b56b24bc661 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:48.126661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-10f494f3-e4b3-4aee-a568-4b56b24bc661 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:48.139103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-10f494f3-e4b3-4aee-a568-4b56b24bc661 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:48.139716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-10f494f3-e4b3-4aee-a568-4b56b24bc661 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:48.140868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-10f494f3-e4b3-4aee-a568-4b56b24bc661 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:48.141686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-10f494f3-e4b3-4aee-a568-4b56b24bc661 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:48.393064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-10f494f3-e4b3-4aee-a568-4b56b24bc661 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:48.404586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-10f494f3-e4b3-4aee-a568-4b56b24bc661 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.286342 Apr 21 14:41:48.405297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 197/384] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:48 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:48.411022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-517a3860-a9e2-4e28-967d-6dac4a84a143 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:48.412292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-517a3860-a9e2-4e28-967d-6dac4a84a143 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:48.428609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-517a3860-a9e2-4e28-967d-6dac4a84a143 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:48.429330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-517a3860-a9e2-4e28-967d-6dac4a84a143 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:48.431091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-517a3860-a9e2-4e28-967d-6dac4a84a143 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:48.431715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-517a3860-a9e2-4e28-967d-6dac4a84a143 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:48.562392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-517a3860-a9e2-4e28-967d-6dac4a84a143 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 32835 microversion: 2.20 time: 0.155414 Apr 21 14:41:48.563391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 198/385] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:48 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 32835 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:48.572525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6ac45760-f51e-4628-802f-3b53f73825c0 req-702f4410-3371-472a-aa68-44a5f73399c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "684834d6-7fa6-4a27-b6cd-56f6c05ac666", "tag": "83fb07ca-21dd-407f-8495-e12f05bc4735"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:48.574489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:41:48.574489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:41:48.588190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6ac45760-f51e-4628-802f-3b53f73825c0 req-702f4410-3371-472a-aa68-44a5f73399c8 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:48.588587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6ac45760-f51e-4628-802f-3b53f73825c0 req-702f4410-3371-472a-aa68-44a5f73399c8 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:48.613208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6ac45760-f51e-4628-802f-3b53f73825c0 req-702f4410-3371-472a-aa68-44a5f73399c8 service nova] Creating event network-changed:83fb07ca-21dd-407f-8495-e12f05bc4735 for instance 684834d6-7fa6-4a27-b6cd-56f6c05ac666 on hv-cinder-78638 Apr 21 14:41:48.619068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6ac45760-f51e-4628-802f-3b53f73825c0 req-702f4410-3371-472a-aa68-44a5f73399c8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053729 Apr 21 14:41:48.620013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 199/386] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:41:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:41:48.739279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:41:48.740044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:41:48.741012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:41:48.741683 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:41:48.742595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:41:48.754690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:48.755414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:48.756481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:48.757018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:48.786805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Getting quotas for project f1fe7acbedbc48509204223f35d7eba2. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:41:48.796495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Getting quotas for user a3d29a86cf6f4ce3ac435e37a40d2396 and project f1fe7acbedbc48509204223f35d7eba2. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:41:48.815035 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:41:48.818650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:41:48.928231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bb4e1b03-c0dd-49a6-841d-34f436b9bc88 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.350165 Apr 21 14:41:48.929629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 188/387] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:41:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 2353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:41:48.945872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-57115be0-6d68-4ec8-a253-4f54b4343c18 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:48.946850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-57115be0-6d68-4ec8-a253-4f54b4343c18 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:49.132186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e73d0030-a99d-4f27-aab6-64b130e4936f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:49.139362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e73d0030-a99d-4f27-aab6-64b130e4936f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:49.174556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e73d0030-a99d-4f27-aab6-64b130e4936f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:49.179396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e73d0030-a99d-4f27-aab6-64b130e4936f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:49.183631 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-57115be0-6d68-4ec8-a253-4f54b4343c18 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:49.184754 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e73d0030-a99d-4f27-aab6-64b130e4936f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:49.185360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e73d0030-a99d-4f27-aab6-64b130e4936f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:49.211396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-57115be0-6d68-4ec8-a253-4f54b4343c18 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1213 microversion: 2.1 time: 0.269854 Apr 21 14:41:49.217812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 200/388] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:48 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1213 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:49.439381 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0dbb5d67-ed66-4a7c-8610-aba4bf726044 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:49.441497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0dbb5d67-ed66-4a7c-8610-aba4bf726044 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:49.464481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0dbb5d67-ed66-4a7c-8610-aba4bf726044 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:49.465847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0dbb5d67-ed66-4a7c-8610-aba4bf726044 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:49.468943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0dbb5d67-ed66-4a7c-8610-aba4bf726044 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:49.469624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0dbb5d67-ed66-4a7c-8610-aba4bf726044 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:49.799763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0dbb5d67-ed66-4a7c-8610-aba4bf726044 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:49.821320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0dbb5d67-ed66-4a7c-8610-aba4bf726044 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.392745 Apr 21 14:41:49.837121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 201/389] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:49 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:49.852685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6c785f76-ab7c-4421-b668-b21b8ae661c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:49.853850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6c785f76-ab7c-4421-b668-b21b8ae661c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:49.862994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c785f76-ab7c-4421-b668-b21b8ae661c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:49.863807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c785f76-ab7c-4421-b668-b21b8ae661c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:49.865045 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c785f76-ab7c-4421-b668-b21b8ae661c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:49.865706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c785f76-ab7c-4421-b668-b21b8ae661c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:50.000841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6c785f76-ab7c-4421-b668-b21b8ae661c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 33806 microversion: 2.20 time: 0.161120 Apr 21 14:41:50.002066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 202/390] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:49 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 33806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:50.086444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e73d0030-a99d-4f27-aab6-64b130e4936f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:50.104608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e73d0030-a99d-4f27-aab6-64b130e4936f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.982926 Apr 21 14:41:50.105668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 189/391] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:49 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:50.246289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fa7fc4c9-323e-437b-af8f-b0f74de3cbdb tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:50.247311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fa7fc4c9-323e-437b-af8f-b0f74de3cbdb tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:50.257757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa7fc4c9-323e-437b-af8f-b0f74de3cbdb tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:50.258841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa7fc4c9-323e-437b-af8f-b0f74de3cbdb tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:50.259936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa7fc4c9-323e-437b-af8f-b0f74de3cbdb tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:50.260665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa7fc4c9-323e-437b-af8f-b0f74de3cbdb tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:50.432236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fa7fc4c9-323e-437b-af8f-b0f74de3cbdb tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:50.443024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fa7fc4c9-323e-437b-af8f-b0f74de3cbdb tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1265 microversion: 2.1 time: 0.201167 Apr 21 14:41:50.444087 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 203/392] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:50 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:50.854867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fa9285fd-00a1-4601-a800-b9151aa793e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:50.855933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fa9285fd-00a1-4601-a800-b9151aa793e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:50.865977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa9285fd-00a1-4601-a800-b9151aa793e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:50.866725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa9285fd-00a1-4601-a800-b9151aa793e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:50.867758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa9285fd-00a1-4601-a800-b9151aa793e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:50.868333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa9285fd-00a1-4601-a800-b9151aa793e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:51.019695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fb65506a-cfae-4c53-b4b8-80ab066dfc0e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:51.021164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fb65506a-cfae-4c53-b4b8-80ab066dfc0e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:51.031692 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb65506a-cfae-4c53-b4b8-80ab066dfc0e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:51.032499 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb65506a-cfae-4c53-b4b8-80ab066dfc0e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:51.033823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb65506a-cfae-4c53-b4b8-80ab066dfc0e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:51.034721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb65506a-cfae-4c53-b4b8-80ab066dfc0e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:51.150140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fb65506a-cfae-4c53-b4b8-80ab066dfc0e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 34879 microversion: 2.20 time: 0.136481 Apr 21 14:41:51.155396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 204/393] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:51 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 34879 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:51.157297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-689fb80a-82f9-4713-9476-f880e6d8464f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:51.159147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-689fb80a-82f9-4713-9476-f880e6d8464f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:51.171669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-689fb80a-82f9-4713-9476-f880e6d8464f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:51.172632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-689fb80a-82f9-4713-9476-f880e6d8464f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:51.173867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-689fb80a-82f9-4713-9476-f880e6d8464f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:51.174856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-689fb80a-82f9-4713-9476-f880e6d8464f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:51.539992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-689fb80a-82f9-4713-9476-f880e6d8464f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:51.559783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-689fb80a-82f9-4713-9476-f880e6d8464f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.406458 Apr 21 14:41:51.561037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 205/394] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:51 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:51.589060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5fae7d58-7800-4517-bec6-dc60066cb5e0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:51.590317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5fae7d58-7800-4517-bec6-dc60066cb5e0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:51.608118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fae7d58-7800-4517-bec6-dc60066cb5e0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:51.608892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fae7d58-7800-4517-bec6-dc60066cb5e0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:51.619954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fae7d58-7800-4517-bec6-dc60066cb5e0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:51.619954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fae7d58-7800-4517-bec6-dc60066cb5e0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:51.782381 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5fae7d58-7800-4517-bec6-dc60066cb5e0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:51.798203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5fae7d58-7800-4517-bec6-dc60066cb5e0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1283 microversion: 2.1 time: 0.225637 Apr 21 14:41:51.799066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 206/395] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:51 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1283 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:52.167000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ba1ca894-abd9-4eab-8555-8ec8ccd3bc53 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:52.169391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ba1ca894-abd9-4eab-8555-8ec8ccd3bc53 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:52.170546 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fa9285fd-00a1-4601-a800-b9151aa793e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:52.184822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba1ca894-abd9-4eab-8555-8ec8ccd3bc53 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:52.185650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba1ca894-abd9-4eab-8555-8ec8ccd3bc53 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:52.187413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba1ca894-abd9-4eab-8555-8ec8ccd3bc53 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:52.188470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba1ca894-abd9-4eab-8555-8ec8ccd3bc53 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:52.188946 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fa9285fd-00a1-4601-a800-b9151aa793e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 1.338306 Apr 21 14:41:52.190036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 190/396] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:50 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:52.402759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ba1ca894-abd9-4eab-8555-8ec8ccd3bc53 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 36167 microversion: 2.20 time: 0.241586 Apr 21 14:41:52.404005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 207/397] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:52 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 36167 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:52.598786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-807e8790-8ac9-44dc-b43f-70b2f7814f86 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:52.600142 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-807e8790-8ac9-44dc-b43f-70b2f7814f86 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:52.616772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-807e8790-8ac9-44dc-b43f-70b2f7814f86 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:52.617720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-807e8790-8ac9-44dc-b43f-70b2f7814f86 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:52.619354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-807e8790-8ac9-44dc-b43f-70b2f7814f86 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:52.620251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-807e8790-8ac9-44dc-b43f-70b2f7814f86 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:52.819286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f70d1a8a-42ff-423b-a2a7-88c263802ce9 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:52.820416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f70d1a8a-42ff-423b-a2a7-88c263802ce9 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:52.831386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f70d1a8a-42ff-423b-a2a7-88c263802ce9 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:52.832096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f70d1a8a-42ff-423b-a2a7-88c263802ce9 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:52.833185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f70d1a8a-42ff-423b-a2a7-88c263802ce9 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:52.833870 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f70d1a8a-42ff-423b-a2a7-88c263802ce9 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:53.027872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f70d1a8a-42ff-423b-a2a7-88c263802ce9 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:53.046081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f70d1a8a-42ff-423b-a2a7-88c263802ce9 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1271 microversion: 2.1 time: 0.231711 Apr 21 14:41:53.047161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 208/398] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:52 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:53.220908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b867bac3-493e-46c1-baa8-882ce7957d08 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:53.222060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b867bac3-493e-46c1-baa8-882ce7957d08 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:53.232080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b867bac3-493e-46c1-baa8-882ce7957d08 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:53.232855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b867bac3-493e-46c1-baa8-882ce7957d08 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:53.233811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b867bac3-493e-46c1-baa8-882ce7957d08 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:53.234463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b867bac3-493e-46c1-baa8-882ce7957d08 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:53.481613 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b867bac3-493e-46c1-baa8-882ce7957d08 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:53.496955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b867bac3-493e-46c1-baa8-882ce7957d08 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.280622 Apr 21 14:41:53.500341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 209/399] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:53 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:53.505144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ddfb689d-019b-4ab2-aa14-2cdd403bfd48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:53.507052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ddfb689d-019b-4ab2-aa14-2cdd403bfd48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:53.516651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddfb689d-019b-4ab2-aa14-2cdd403bfd48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:53.517158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddfb689d-019b-4ab2-aa14-2cdd403bfd48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:53.518060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddfb689d-019b-4ab2-aa14-2cdd403bfd48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:53.518733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddfb689d-019b-4ab2-aa14-2cdd403bfd48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:53.662969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-807e8790-8ac9-44dc-b43f-70b2f7814f86 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:53.672608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-807e8790-8ac9-44dc-b43f-70b2f7814f86 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 1.083001 Apr 21 14:41:53.673154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 191/400] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:52 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:53.723536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ddfb689d-019b-4ab2-aa14-2cdd403bfd48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 37437 microversion: 2.20 time: 0.223284 Apr 21 14:41:53.724460 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 210/401] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:53 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 37437 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:54.065235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b8c5982b-7e1c-4301-a508-aaf7bcc774d1 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:54.065907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b8c5982b-7e1c-4301-a508-aaf7bcc774d1 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:54.074799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8c5982b-7e1c-4301-a508-aaf7bcc774d1 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:54.075343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8c5982b-7e1c-4301-a508-aaf7bcc774d1 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:54.076137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8c5982b-7e1c-4301-a508-aaf7bcc774d1 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:54.076629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8c5982b-7e1c-4301-a508-aaf7bcc774d1 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:54.243371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b8c5982b-7e1c-4301-a508-aaf7bcc774d1 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:54.259083 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b8c5982b-7e1c-4301-a508-aaf7bcc774d1 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1271 microversion: 2.1 time: 0.197294 Apr 21 14:41:54.262842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 192/402] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:54 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:54.528204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-113aa99c-2801-4922-9760-20f203f230ec tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:54.529458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-113aa99c-2801-4922-9760-20f203f230ec tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:54.541903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-113aa99c-2801-4922-9760-20f203f230ec tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:54.543628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-113aa99c-2801-4922-9760-20f203f230ec tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:54.545246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-113aa99c-2801-4922-9760-20f203f230ec tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:54.546216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-113aa99c-2801-4922-9760-20f203f230ec tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:54.697772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-344b8db0-6c75-4633-9c12-09c16b16df5d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:54.699434 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-344b8db0-6c75-4633-9c12-09c16b16df5d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:54.714956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-344b8db0-6c75-4633-9c12-09c16b16df5d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:54.716190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-344b8db0-6c75-4633-9c12-09c16b16df5d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:54.718028 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-344b8db0-6c75-4633-9c12-09c16b16df5d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:54.719149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-344b8db0-6c75-4633-9c12-09c16b16df5d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:55.158278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-344b8db0-6c75-4633-9c12-09c16b16df5d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:55.180479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-344b8db0-6c75-4633-9c12-09c16b16df5d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.491192 Apr 21 14:41:55.181494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 193/403] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:54 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:55.196696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c6d1b379-19b1-45c8-8067-84116bcc18db tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:55.198850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c6d1b379-19b1-45c8-8067-84116bcc18db tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:55.219621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6d1b379-19b1-45c8-8067-84116bcc18db tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:55.220831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6d1b379-19b1-45c8-8067-84116bcc18db tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:55.229553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6d1b379-19b1-45c8-8067-84116bcc18db tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:55.230838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6d1b379-19b1-45c8-8067-84116bcc18db tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:55.441351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c6d1b379-19b1-45c8-8067-84116bcc18db tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 38209 microversion: 2.20 time: 0.252300 Apr 21 14:41:55.442273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 194/404] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:55 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 38209 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:55.449288 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-50e1865c-7644-45ce-8da9-0c140ea91084 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:55.455428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-50e1865c-7644-45ce-8da9-0c140ea91084 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:55.474762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50e1865c-7644-45ce-8da9-0c140ea91084 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:55.475577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50e1865c-7644-45ce-8da9-0c140ea91084 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:55.477010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50e1865c-7644-45ce-8da9-0c140ea91084 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:55.477665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50e1865c-7644-45ce-8da9-0c140ea91084 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:55.702303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-113aa99c-2801-4922-9760-20f203f230ec tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:55.729840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-113aa99c-2801-4922-9760-20f203f230ec tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 1.212605 Apr 21 14:41:55.730977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 211/405] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:54 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:56.179598 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-50e1865c-7644-45ce-8da9-0c140ea91084 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:56.190904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-50e1865c-7644-45ce-8da9-0c140ea91084 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1313 microversion: 2.1 time: 0.747109 Apr 21 14:41:56.195607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 195/406] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:55 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1313 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:56.201440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b3adc143-58fa-43dd-a79a-772e00d51c04 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:56.202540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b3adc143-58fa-43dd-a79a-772e00d51c04 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:56.222214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3adc143-58fa-43dd-a79a-772e00d51c04 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:56.222650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3adc143-58fa-43dd-a79a-772e00d51c04 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:56.223627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3adc143-58fa-43dd-a79a-772e00d51c04 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:56.224185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3adc143-58fa-43dd-a79a-772e00d51c04 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:56.427107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-7a990476-09e6-43b1-9de8-a6da110c4e00 req-cdc84b03-71a8-4dbd-8a40-d242d95930a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f109b33e-030d-4af9-8fdc-0349a03762fe", "tag": "c502f116-b6a2-4756-ba26-b93734eb54c3"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:56.429407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:41:56.429407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:41:56.463429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7a990476-09e6-43b1-9de8-a6da110c4e00 req-cdc84b03-71a8-4dbd-8a40-d242d95930a8 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:56.464029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7a990476-09e6-43b1-9de8-a6da110c4e00 req-cdc84b03-71a8-4dbd-8a40-d242d95930a8 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:56.538307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-7a990476-09e6-43b1-9de8-a6da110c4e00 req-cdc84b03-71a8-4dbd-8a40-d242d95930a8 service nova] Creating event network-changed:c502f116-b6a2-4756-ba26-b93734eb54c3 for instance f109b33e-030d-4af9-8fdc-0349a03762fe on hv-cinder-78638 Apr 21 14:41:56.548200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-7a990476-09e6-43b1-9de8-a6da110c4e00 req-cdc84b03-71a8-4dbd-8a40-d242d95930a8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126593 Apr 21 14:41:56.549910 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 196/407] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:41:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:41:56.558863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-199f12d2-02f5-44ef-86dc-5c2419c636c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:56.560275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-199f12d2-02f5-44ef-86dc-5c2419c636c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:56.571314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-199f12d2-02f5-44ef-86dc-5c2419c636c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:56.572220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-199f12d2-02f5-44ef-86dc-5c2419c636c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:56.573442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-199f12d2-02f5-44ef-86dc-5c2419c636c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:56.574030 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-199f12d2-02f5-44ef-86dc-5c2419c636c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:56.717100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-199f12d2-02f5-44ef-86dc-5c2419c636c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 38209 microversion: 2.20 time: 0.164237 Apr 21 14:41:56.718325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 197/408] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:56 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 38209 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:56.759404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1c69194d-d3b8-4fd8-bd5e-41657ef6d2e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:56.760178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1c69194d-d3b8-4fd8-bd5e-41657ef6d2e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:56.769394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c69194d-d3b8-4fd8-bd5e-41657ef6d2e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:56.769911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c69194d-d3b8-4fd8-bd5e-41657ef6d2e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:56.770810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c69194d-d3b8-4fd8-bd5e-41657ef6d2e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:56.771374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c69194d-d3b8-4fd8-bd5e-41657ef6d2e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:56.799952 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b3adc143-58fa-43dd-a79a-772e00d51c04 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:56.818786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b3adc143-58fa-43dd-a79a-772e00d51c04 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.621396 Apr 21 14:41:56.820329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 212/409] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:56 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:41:57.226138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5a0433f3-a07e-4fe6-889b-28e41985c42d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:57.229621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5a0433f3-a07e-4fe6-889b-28e41985c42d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:57.244716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a0433f3-a07e-4fe6-889b-28e41985c42d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:57.245185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a0433f3-a07e-4fe6-889b-28e41985c42d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:57.246139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a0433f3-a07e-4fe6-889b-28e41985c42d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:57.246634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a0433f3-a07e-4fe6-889b-28e41985c42d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:57.709459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c69194d-d3b8-4fd8-bd5e-41657ef6d2e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:57.736595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1c69194d-d3b8-4fd8-bd5e-41657ef6d2e3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.981412 Apr 21 14:41:57.738488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 198/410] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:56 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:57.749768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34fcb0c5-c534-4dd4-acd8-2add46d2ee48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:41:57.752435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34fcb0c5-c534-4dd4-acd8-2add46d2ee48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:57.780918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34fcb0c5-c534-4dd4-acd8-2add46d2ee48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:57.781445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34fcb0c5-c534-4dd4-acd8-2add46d2ee48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:57.782365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34fcb0c5-c534-4dd4-acd8-2add46d2ee48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:57.782876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34fcb0c5-c534-4dd4-acd8-2add46d2ee48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:57.929597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34fcb0c5-c534-4dd4-acd8-2add46d2ee48 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 200 len: 38350 microversion: 2.20 time: 0.188912 Apr 21 14:41:57.935378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 199/411] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:41:57 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 38350 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:41:57.936319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-659c5d28-6c44-458f-9bfc-ae42d5f237e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:57.943578 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-659c5d28-6c44-458f-9bfc-ae42d5f237e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:57.954755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-659c5d28-6c44-458f-9bfc-ae42d5f237e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:57.955278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-659c5d28-6c44-458f-9bfc-ae42d5f237e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:57.956143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-659c5d28-6c44-458f-9bfc-ae42d5f237e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:57.956647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-659c5d28-6c44-458f-9bfc-ae42d5f237e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:58.312624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5a0433f3-a07e-4fe6-889b-28e41985c42d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:58.328676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5a0433f3-a07e-4fe6-889b-28e41985c42d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1313 microversion: 2.1 time: 1.108612 Apr 21 14:41:58.329711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 213/412] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:57 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1313 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:58.338826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0c606191-5204-4b57-b575-7eb096183d59 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:58.340205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0c606191-5204-4b57-b575-7eb096183d59 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:58.355771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c606191-5204-4b57-b575-7eb096183d59 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:58.356912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c606191-5204-4b57-b575-7eb096183d59 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:58.358489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c606191-5204-4b57-b575-7eb096183d59 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:58.359664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c606191-5204-4b57-b575-7eb096183d59 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:58.412586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-659c5d28-6c44-458f-9bfc-ae42d5f237e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:58.429669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-659c5d28-6c44-458f-9bfc-ae42d5f237e4 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.497166 Apr 21 14:41:58.430679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 200/413] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:57 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:58.463498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0c606191-5204-4b57-b575-7eb096183d59 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/ips" status: 200 len: 152 microversion: 2.20 time: 0.131702 Apr 21 14:41:58.464639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 214/414] 10.222.0.24 () {60 vars in 1279 bytes} [Wed Apr 21 14:41:58 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/ips => generated 152 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:41:58.758753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a8d2e967-23c4-469b-a40f-215960d6d7b0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:58.760341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a8d2e967-23c4-469b-a40f-215960d6d7b0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:58.784159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8d2e967-23c4-469b-a40f-215960d6d7b0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:58.784586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8d2e967-23c4-469b-a40f-215960d6d7b0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:58.785534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8d2e967-23c4-469b-a40f-215960d6d7b0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:58.786068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8d2e967-23c4-469b-a40f-215960d6d7b0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:59.316811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a8d2e967-23c4-469b-a40f-215960d6d7b0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:59.330717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a8d2e967-23c4-469b-a40f-215960d6d7b0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.577724 Apr 21 14:41:59.331730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 201/415] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:58 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:59.348757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a15a7b3f-e243-48f9-a76f-33d2b46b0c60 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:59.350403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a15a7b3f-e243-48f9-a76f-33d2b46b0c60 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:59.364961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a15a7b3f-e243-48f9-a76f-33d2b46b0c60 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:59.366117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a15a7b3f-e243-48f9-a76f-33d2b46b0c60 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:59.367255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a15a7b3f-e243-48f9-a76f-33d2b46b0c60 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:59.368075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a15a7b3f-e243-48f9-a76f-33d2b46b0c60 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:59.454335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-40db5fc0-acf1-419d-bd70-ed75b960a7e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:41:59.455601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-40db5fc0-acf1-419d-bd70-ed75b960a7e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:41:59.469505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40db5fc0-acf1-419d-bd70-ed75b960a7e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:59.470392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40db5fc0-acf1-419d-bd70-ed75b960a7e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:59.473370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40db5fc0-acf1-419d-bd70-ed75b960a7e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:41:59.474823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40db5fc0-acf1-419d-bd70-ed75b960a7e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:41:59.772421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a15a7b3f-e243-48f9-a76f-33d2b46b0c60 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:59.793924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a15a7b3f-e243-48f9-a76f-33d2b46b0c60 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1313 microversion: 2.1 time: 0.449491 Apr 21 14:41:59.794190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-40db5fc0-acf1-419d-bd70-ed75b960a7e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:41:59.795602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 215/416] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:59 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:41:59.806240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-40db5fc0-acf1-419d-bd70-ed75b960a7e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.359819 Apr 21 14:41:59.807270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 202/417] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:41:59 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:00.200000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ea0cb8b5-1275-4b3c-86ce-281c79ab6f20 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Action: 'create', calling method: .version_select at 0x7f19df311400>, body: {"keypair": {"name": "tempest-TestShelveInstance-482307021"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:00.228875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ea0cb8b5-1275-4b3c-86ce-281c79ab6f20 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Getting quotas for project a6d44a65707b47e1b0190ca77b504c5a. Resources: {'key_pairs'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:42:00.234008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ea0cb8b5-1275-4b3c-86ce-281c79ab6f20 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Getting quotas for user b688274f9d8b4061afbf14e6d4646764 and project a6d44a65707b47e1b0190ca77b504c5a. Resources: {'key_pairs'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:42:00.350033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f07f4d4a-8845-4157-aa1b-2ad98181d763 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:00.350485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f07f4d4a-8845-4157-aa1b-2ad98181d763 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:00.362318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f07f4d4a-8845-4157-aa1b-2ad98181d763 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:00.362829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f07f4d4a-8845-4157-aa1b-2ad98181d763 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:00.363682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f07f4d4a-8845-4157-aa1b-2ad98181d763 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:00.364184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f07f4d4a-8845-4157-aa1b-2ad98181d763 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:00.623907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ea0cb8b5-1275-4b3c-86ce-281c79ab6f20 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Getting quotas for project a6d44a65707b47e1b0190ca77b504c5a. Resources: {'key_pairs'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:42:00.630023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ea0cb8b5-1275-4b3c-86ce-281c79ab6f20 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Getting quotas for user b688274f9d8b4061afbf14e6d4646764 and project a6d44a65707b47e1b0190ca77b504c5a. Resources: {'key_pairs'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:42:00.649779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ea0cb8b5-1275-4b3c-86ce-281c79ab6f20 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.852618 Apr 21 14:42:00.650508 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 216/418] 10.222.0.24 () {60 vars in 1148 bytes} [Wed Apr 21 14:41:59 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:00.715574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f07f4d4a-8845-4157-aa1b-2ad98181d763 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:00.726070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f07f4d4a-8845-4157-aa1b-2ad98181d763 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.380668 Apr 21 14:42:00.726699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 203/419] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:00 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:42:00.765725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-06b047ab-222b-4a9b-acd3-93fd442ea589 req-14f54e17-ef4d-4695-ba97-a280317acd33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684834d6-7fa6-4a27-b6cd-56f6c05ac666", "name": "network-vif-plugged", "status": "completed", "tag": "83fb07ca-21dd-407f-8495-e12f05bc4735"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:00.767445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:00.767445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:00.780360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-06b047ab-222b-4a9b-acd3-93fd442ea589 req-14f54e17-ef4d-4695-ba97-a280317acd33 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:00.781152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-06b047ab-222b-4a9b-acd3-93fd442ea589 req-14f54e17-ef4d-4695-ba97-a280317acd33 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:00.800702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-06b047ab-222b-4a9b-acd3-93fd442ea589 req-14f54e17-ef4d-4695-ba97-a280317acd33 service nova] Creating event network-vif-plugged:83fb07ca-21dd-407f-8495-e12f05bc4735 for instance 684834d6-7fa6-4a27-b6cd-56f6c05ac666 on hv-cinder-78638 Apr 21 14:42:00.807120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-06b047ab-222b-4a9b-acd3-93fd442ea589 req-14f54e17-ef4d-4695-ba97-a280317acd33 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045772 Apr 21 14:42:00.807840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 217/420] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:42:00.816551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-697ff4bd-7140-4f2d-8fbb-df98259735c0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:00.819550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-697ff4bd-7140-4f2d-8fbb-df98259735c0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:00.832599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-697ff4bd-7140-4f2d-8fbb-df98259735c0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:00.837054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-697ff4bd-7140-4f2d-8fbb-df98259735c0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:00.838009 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7ff7afec-8570-4a06-bc6c-1a2c3dc08c52 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:00.840086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7ff7afec-8570-4a06-bc6c-1a2c3dc08c52 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:00.840632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-697ff4bd-7140-4f2d-8fbb-df98259735c0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:00.841359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-697ff4bd-7140-4f2d-8fbb-df98259735c0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:00.861688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ff7afec-8570-4a06-bc6c-1a2c3dc08c52 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:00.862328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ff7afec-8570-4a06-bc6c-1a2c3dc08c52 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:00.863236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ff7afec-8570-4a06-bc6c-1a2c3dc08c52 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:00.863946 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ff7afec-8570-4a06-bc6c-1a2c3dc08c52 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:01.414314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-697ff4bd-7140-4f2d-8fbb-df98259735c0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:01.431888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-697ff4bd-7140-4f2d-8fbb-df98259735c0 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1313 microversion: 2.1 time: 0.619304 Apr 21 14:42:01.432577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 204/421] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:00 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:01.521590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d77d4ed0-9c5b-4e10-91a0-d76d39b59208 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:01.522287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d77d4ed0-9c5b-4e10-91a0-d76d39b59208 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:01.532232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed0-9c5b-4e10-91a0-d76d39b59208 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:01.533155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed0-9c5b-4e10-91a0-d76d39b59208 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:01.534714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed0-9c5b-4e10-91a0-d76d39b59208 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:01.536054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed0-9c5b-4e10-91a0-d76d39b59208 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:01.542902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7ff7afec-8570-4a06-bc6c-1a2c3dc08c52 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:01.554899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7ff7afec-8570-4a06-bc6c-1a2c3dc08c52 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.730598 Apr 21 14:42:01.555580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 218/422] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:00 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:01.628408 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-d77d4ed0-9c5b-4e10-91a0-d76d39b59208 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lazy-loading 'flavor' on Instance uuid abf3aa87-b02a-4b58-901a-76f4e825e75a {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:42:01.761364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-55c95d03-9937-4538-8625-35c8d682d14c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:01.763085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-55c95d03-9937-4538-8625-35c8d682d14c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:01.787315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-55c95d03-9937-4538-8625-35c8d682d14c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:01.789846 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-55c95d03-9937-4538-8625-35c8d682d14c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:01.792075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-55c95d03-9937-4538-8625-35c8d682d14c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:01.793272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-55c95d03-9937-4538-8625-35c8d682d14c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:02.162627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-55c95d03-9937-4538-8625-35c8d682d14c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:02.177075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-55c95d03-9937-4538-8625-35c8d682d14c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.424617 Apr 21 14:42:02.188825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 219/423] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:01 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:02.217453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d77d4ed0-9c5b-4e10-91a0-d76d39b59208 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 202 len: 0 microversion: 2.20 time: 0.700577 Apr 21 14:42:02.218656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 205/424] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:42:01 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 21 14:42:02.230686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:02.232039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:02.256022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:02.256772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:02.257686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:02.258227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:02.456836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-64845919-5c93-4a76-9cfc-5f201626d8c4 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:02.458315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-64845919-5c93-4a76-9cfc-5f201626d8c4 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:02.473919 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-64845919-5c93-4a76-9cfc-5f201626d8c4 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:02.474637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-64845919-5c93-4a76-9cfc-5f201626d8c4 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:02.475586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-64845919-5c93-4a76-9cfc-5f201626d8c4 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:02.476355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-64845919-5c93-4a76-9cfc-5f201626d8c4 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:02.584878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:02.597142 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:02.598965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:02.600659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9a033e7c-451e-4353-b8e8-a9181cd72357 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.376638 Apr 21 14:42:02.601899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 220/425] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:02 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:02.607302 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6b667100-23e7-4d9c-83c0-87ba76e4ba43 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:02.608352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6b667100-23e7-4d9c-83c0-87ba76e4ba43 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:02.617224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6b667100-23e7-4d9c-83c0-87ba76e4ba43 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:02.618189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6b667100-23e7-4d9c-83c0-87ba76e4ba43 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:02.619277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6b667100-23e7-4d9c-83c0-87ba76e4ba43 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:02.619974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6b667100-23e7-4d9c-83c0-87ba76e4ba43 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:02.983746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-64845919-5c93-4a76-9cfc-5f201626d8c4 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:02.984313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6b667100-23e7-4d9c-83c0-87ba76e4ba43 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:02.996021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6b667100-23e7-4d9c-83c0-87ba76e4ba43 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1318 microversion: 2.1 time: 0.392620 Apr 21 14:42:02.996662 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 221/426] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:02 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:03.014973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-64845919-5c93-4a76-9cfc-5f201626d8c4 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1313 microversion: 2.1 time: 0.563200 Apr 21 14:42:03.015757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 206/427] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:02 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:03.196933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b45290ba-5cde-44af-9c39-fe5fe598612f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:03.197684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b45290ba-5cde-44af-9c39-fe5fe598612f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:03.219309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b45290ba-5cde-44af-9c39-fe5fe598612f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:03.224351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b45290ba-5cde-44af-9c39-fe5fe598612f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:03.226199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b45290ba-5cde-44af-9c39-fe5fe598612f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:03.228751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b45290ba-5cde-44af-9c39-fe5fe598612f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:03.595428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b45290ba-5cde-44af-9c39-fe5fe598612f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:03.633124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b45290ba-5cde-44af-9c39-fe5fe598612f tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.440177 Apr 21 14:42:03.634486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 222/428] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:03 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:03.636070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:03.636996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:03.646985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:03.647841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:03.648934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:03.649686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:03.969534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:03.984533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:03.989596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:03.992636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6302c249-555b-4cfe-a424-8d70c1fa543d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.360457 Apr 21 14:42:03.994678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 207/429] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:03 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:42:04.023891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-df26fa18-4883-44c8-ad96-6f8de93f38c6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:04.025508 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-df26fa18-4883-44c8-ad96-6f8de93f38c6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:04.054454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-22c35677-0641-4c8e-b775-59a962f127e5 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:04.055573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-22c35677-0641-4c8e-b775-59a962f127e5 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:04.066334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df26fa18-4883-44c8-ad96-6f8de93f38c6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:04.066960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df26fa18-4883-44c8-ad96-6f8de93f38c6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:04.070222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df26fa18-4883-44c8-ad96-6f8de93f38c6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:04.070738 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df26fa18-4883-44c8-ad96-6f8de93f38c6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:04.080644 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22c35677-0641-4c8e-b775-59a962f127e5 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:04.081213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22c35677-0641-4c8e-b775-59a962f127e5 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:04.082086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22c35677-0641-4c8e-b775-59a962f127e5 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:04.083162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22c35677-0641-4c8e-b775-59a962f127e5 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:04.513246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-22c35677-0641-4c8e-b775-59a962f127e5 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:04.521295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-df26fa18-4883-44c8-ad96-6f8de93f38c6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:04.525944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-22c35677-0641-4c8e-b775-59a962f127e5 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1313 microversion: 2.1 time: 0.480650 Apr 21 14:42:04.528156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 208/430] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:04 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:04.532812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-df26fa18-4883-44c8-ad96-6f8de93f38c6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1509 microversion: 2.1 time: 0.517613 Apr 21 14:42:04.534345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 223/431] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:04 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1509 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:04.662103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-daa21c67-1412-411f-bfec-4427524dd78e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:04.662761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-daa21c67-1412-411f-bfec-4427524dd78e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:04.673716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-daa21c67-1412-411f-bfec-4427524dd78e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:04.674588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-daa21c67-1412-411f-bfec-4427524dd78e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:04.677188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-daa21c67-1412-411f-bfec-4427524dd78e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:04.678609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-daa21c67-1412-411f-bfec-4427524dd78e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:05.030263 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:05.030925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:05.043423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:05.046019 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:05.047360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:05.048004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:05.292319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-daa21c67-1412-411f-bfec-4427524dd78e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:05.324857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-daa21c67-1412-411f-bfec-4427524dd78e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.666706 Apr 21 14:42:05.326072 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 209/432] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:04 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:05.557108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0e7054ef-4883-41a2-97cc-57f2ecac9b93 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:05.558125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0e7054ef-4883-41a2-97cc-57f2ecac9b93 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:05.571423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e7054ef-4883-41a2-97cc-57f2ecac9b93 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:05.575776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e7054ef-4883-41a2-97cc-57f2ecac9b93 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:05.579282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e7054ef-4883-41a2-97cc-57f2ecac9b93 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:05.580424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e7054ef-4883-41a2-97cc-57f2ecac9b93 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:05.588066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:05.601553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:05.603711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:05.605270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a0bab34e-96b9-4d94-a6db-24f8db19f083 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.580903 Apr 21 14:42:05.606140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 224/433] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:05 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:06.093334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0e7054ef-4883-41a2-97cc-57f2ecac9b93 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:06.118441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0e7054ef-4883-41a2-97cc-57f2ecac9b93 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1313 microversion: 2.1 time: 0.565331 Apr 21 14:42:06.120042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 210/434] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:05 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:06.344435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1f18a622-d4d7-4cc1-90ed-9a0d06b576e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:06.345024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1f18a622-d4d7-4cc1-90ed-9a0d06b576e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:06.363938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f18a622-d4d7-4cc1-90ed-9a0d06b576e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:06.364781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f18a622-d4d7-4cc1-90ed-9a0d06b576e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:06.366024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f18a622-d4d7-4cc1-90ed-9a0d06b576e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:06.366676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f18a622-d4d7-4cc1-90ed-9a0d06b576e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:06.518463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-55179089-766a-45b0-b35e-50d46109f8f7 req-a6d9ca4c-1e4f-45a2-b709-27f6fbb767e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f109b33e-030d-4af9-8fdc-0349a03762fe", "name": "network-vif-plugged", "status": "completed", "tag": "c502f116-b6a2-4756-ba26-b93734eb54c3"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:06.521049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:06.521049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:06.544478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-55179089-766a-45b0-b35e-50d46109f8f7 req-a6d9ca4c-1e4f-45a2-b709-27f6fbb767e2 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:06.545004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-55179089-766a-45b0-b35e-50d46109f8f7 req-a6d9ca4c-1e4f-45a2-b709-27f6fbb767e2 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:06.595277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-55179089-766a-45b0-b35e-50d46109f8f7 req-a6d9ca4c-1e4f-45a2-b709-27f6fbb767e2 service nova] Creating event network-vif-plugged:c502f116-b6a2-4756-ba26-b93734eb54c3 for instance f109b33e-030d-4af9-8fdc-0349a03762fe on hv-cinder-78638 Apr 21 14:42:06.610183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-55179089-766a-45b0-b35e-50d46109f8f7 req-a6d9ca4c-1e4f-45a2-b709-27f6fbb767e2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097335 Apr 21 14:42:06.614178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 211/435] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Apr 21 14:42:06.642128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:06.643183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:06.667731 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:06.671693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:06.673023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:06.676223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:07.181475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1f18a622-d4d7-4cc1-90ed-9a0d06b576e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:07.192454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1f18a622-d4d7-4cc1-90ed-9a0d06b576e0 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.852177 Apr 21 14:42:07.193567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 225/436] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:06 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:07.199314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-df39df72-a034-416a-bf80-896718ede988 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06e9ec9a-2e03-4308-81e7-ae74a95549ff"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:07.201068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-df39df72-a034-416a-bf80-896718ede988 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:07.210441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df39df72-a034-416a-bf80-896718ede988 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:07.211659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df39df72-a034-416a-bf80-896718ede988 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:07.211801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df39df72-a034-416a-bf80-896718ede988 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:07.212409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df39df72-a034-416a-bf80-896718ede988 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:07.321290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:07.332513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:07.334355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:07.335601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aa36ecd9-4e08-4d4e-a462-7e507337fc25 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.698569 Apr 21 14:42:07.336619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 212/437] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:06 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:42:07.342314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-659ed8e3-2637-44b6-8083-1ffb712bc068 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:07.342987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-659ed8e3-2637-44b6-8083-1ffb712bc068 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:07.354133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-659ed8e3-2637-44b6-8083-1ffb712bc068 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:07.354133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-659ed8e3-2637-44b6-8083-1ffb712bc068 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:07.354133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-659ed8e3-2637-44b6-8083-1ffb712bc068 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:07.354133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-659ed8e3-2637-44b6-8083-1ffb712bc068 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:07.620892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-659ed8e3-2637-44b6-8083-1ffb712bc068 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:07.631673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-659ed8e3-2637-44b6-8083-1ffb712bc068 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1313 microversion: 2.1 time: 0.293636 Apr 21 14:42:07.632687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 213/438] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:07 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:07.784234 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-df39df72-a034-416a-bf80-896718ede988 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "POST /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.589220 Apr 21 14:42:07.784945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 226/439] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:42:07 2021] POST /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:42:08.232034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b218eacd-5044-4f7a-8918-7a2aac8fb987 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:08.232715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b218eacd-5044-4f7a-8918-7a2aac8fb987 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:08.241967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b218eacd-5044-4f7a-8918-7a2aac8fb987 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:08.242564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b218eacd-5044-4f7a-8918-7a2aac8fb987 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:08.243465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b218eacd-5044-4f7a-8918-7a2aac8fb987 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:08.243967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b218eacd-5044-4f7a-8918-7a2aac8fb987 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:08.372048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:08.372961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:08.385171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:08.385880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:08.387298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:08.387927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:08.532168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b218eacd-5044-4f7a-8918-7a2aac8fb987 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:08.544726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b218eacd-5044-4f7a-8918-7a2aac8fb987 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1567 microversion: 2.1 time: 0.316825 Apr 21 14:42:08.545687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 214/440] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:08 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1567 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:08.657297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e3fa1948-c7c5-471b-b01e-23caa426cd4e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:08.658017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e3fa1948-c7c5-471b-b01e-23caa426cd4e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:08.667935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e3fa1948-c7c5-471b-b01e-23caa426cd4e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:08.668458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e3fa1948-c7c5-471b-b01e-23caa426cd4e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:08.669576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e3fa1948-c7c5-471b-b01e-23caa426cd4e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:08.669841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e3fa1948-c7c5-471b-b01e-23caa426cd4e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:08.685313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:08.706062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:08.707914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:08.709577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b6050db8-703c-41a4-b301-f6f5c84db90b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.342738 Apr 21 14:42:08.711125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 227/441] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:08 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:42:08.929258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e3fa1948-c7c5-471b-b01e-23caa426cd4e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:08.939676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e3fa1948-c7c5-471b-b01e-23caa426cd4e tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1313 microversion: 2.1 time: 0.286312 Apr 21 14:42:08.940407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 215/442] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:08 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:42:09.577925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-43bbd21d-63a0-43d3-9892-9377d2b75f62 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:09.579119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-43bbd21d-63a0-43d3-9892-9377d2b75f62 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:09.595120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43bbd21d-63a0-43d3-9892-9377d2b75f62 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:09.596015 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43bbd21d-63a0-43d3-9892-9377d2b75f62 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:09.597535 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43bbd21d-63a0-43d3-9892-9377d2b75f62 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:09.598475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43bbd21d-63a0-43d3-9892-9377d2b75f62 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:09.742426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:09.743659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:09.755597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:09.756197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:09.757502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:09.758374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:09.897400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-43bbd21d-63a0-43d3-9892-9377d2b75f62 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:09.909435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-43bbd21d-63a0-43d3-9892-9377d2b75f62 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1547 microversion: 2.1 time: 0.339196 Apr 21 14:42:09.910554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 228/443] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:09 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1547 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:09.929189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b83070d7-cdf0-4370-8a95-3891689cbd18 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:09.929846 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b83070d7-cdf0-4370-8a95-3891689cbd18 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:09.939023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b83070d7-cdf0-4370-8a95-3891689cbd18 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:09.939532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b83070d7-cdf0-4370-8a95-3891689cbd18 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:09.940408 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b83070d7-cdf0-4370-8a95-3891689cbd18 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:09.941599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b83070d7-cdf0-4370-8a95-3891689cbd18 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:10.117132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:10.130672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:10.132602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:10.134193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-24e6f3f7-13db-4129-b7e0-1e02c4fa0f68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.396727 Apr 21 14:42:10.135089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 216/444] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:09 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:42:10.140956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bb0e919e-5bd7-4b86-b072-4c5a1e47cd45 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:10.142207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bb0e919e-5bd7-4b86-b072-4c5a1e47cd45 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:10.151201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb0e919e-5bd7-4b86-b072-4c5a1e47cd45 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:10.151942 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb0e919e-5bd7-4b86-b072-4c5a1e47cd45 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:10.152946 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb0e919e-5bd7-4b86-b072-4c5a1e47cd45 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:10.153556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb0e919e-5bd7-4b86-b072-4c5a1e47cd45 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:10.214982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-b83070d7-cdf0-4370-8a95-3891689cbd18 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] HTTP exception thrown: Cannot 'detach_volume' instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb while it is in vm_state rescued Apr 21 14:42:10.215681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b83070d7-cdf0-4370-8a95-3891689cbd18 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Returning 409 to user: Cannot 'detach_volume' instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb while it is in vm_state rescued {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:42:10.216635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b83070d7-cdf0-4370-8a95-3891689cbd18 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/os-volume_attachments/984a3c51-dad4-4a91-acdf-f97041b6ed12" status: 409 len: 152 microversion: 2.1 time: 0.292398 Apr 21 14:42:10.217302 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 229/445] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:42:09 2021] DELETE /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/os-volume_attachments/984a3c51-dad4-4a91-acdf-f97041b6ed12 => generated 152 bytes in 294 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 21 14:42:10.229105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a81fc0c6-61a5-458b-b68d-d01c08a3196e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:10.229823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a81fc0c6-61a5-458b-b68d-d01c08a3196e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:10.238539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a81fc0c6-61a5-458b-b68d-d01c08a3196e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:10.239046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a81fc0c6-61a5-458b-b68d-d01c08a3196e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:10.239965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a81fc0c6-61a5-458b-b68d-d01c08a3196e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:10.240466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a81fc0c6-61a5-458b-b68d-d01c08a3196e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:10.407287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a81fc0c6-61a5-458b-b68d-d01c08a3196e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/action" status: 202 len: 0 microversion: 2.1 time: 0.182007 Apr 21 14:42:10.412573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 230/446] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:42:10 2021] POST /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:42:10.418559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7db996e0-b21a-4422-8296-1086bded0145 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:10.419429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7db996e0-b21a-4422-8296-1086bded0145 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:10.430881 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7db996e0-b21a-4422-8296-1086bded0145 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:10.431590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7db996e0-b21a-4422-8296-1086bded0145 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:10.436204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7db996e0-b21a-4422-8296-1086bded0145 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:10.436204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7db996e0-b21a-4422-8296-1086bded0145 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:10.436658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bb0e919e-5bd7-4b86-b072-4c5a1e47cd45 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:10.445601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bb0e919e-5bd7-4b86-b072-4c5a1e47cd45 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1496 microversion: 2.1 time: 0.309151 Apr 21 14:42:10.446920 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 217/447] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:10 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1496 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:10.692717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7db996e0-b21a-4422-8296-1086bded0145 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:10.704865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7db996e0-b21a-4422-8296-1086bded0145 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1555 microversion: 2.1 time: 0.290958 Apr 21 14:42:10.705543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 231/448] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:10 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1555 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:11.165653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:11.166412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:11.175179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:11.176010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:11.176881 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:11.177441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:11.476370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8fdea458-6508-49af-9be8-c641f064b055 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:11.476912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8fdea458-6508-49af-9be8-c641f064b055 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:11.486693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fdea458-6508-49af-9be8-c641f064b055 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:11.487318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fdea458-6508-49af-9be8-c641f064b055 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:11.488197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fdea458-6508-49af-9be8-c641f064b055 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:11.488681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fdea458-6508-49af-9be8-c641f064b055 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:11.594398 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8fdea458-6508-49af-9be8-c641f064b055 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:42:11.745233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8fdea458-6508-49af-9be8-c641f064b055 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 204 len: 0 microversion: 2.1 time: 0.272883 Apr 21 14:42:11.745848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 232/449] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:42:11 2021] DELETE /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:42:11.751916 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-43d604eb-bdbc-4cd7-9420-a8ebfcdafe75 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:11.753136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-43d604eb-bdbc-4cd7-9420-a8ebfcdafe75 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:11.762007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43d604eb-bdbc-4cd7-9420-a8ebfcdafe75 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:11.763032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43d604eb-bdbc-4cd7-9420-a8ebfcdafe75 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:11.764194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43d604eb-bdbc-4cd7-9420-a8ebfcdafe75 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:11.764851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43d604eb-bdbc-4cd7-9420-a8ebfcdafe75 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:11.837877 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:11.852404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:11.854143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:11.855806 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-639f88bb-b219-46d1-b137-67d5b6258785 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.694371 Apr 21 14:42:11.856964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 218/450] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:11 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:11.862023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-61bdca18-c22f-4838-beda-da2d71c7b38d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:11.862696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-61bdca18-c22f-4838-beda-da2d71c7b38d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:11.872316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61bdca18-c22f-4838-beda-da2d71c7b38d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:11.873090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61bdca18-c22f-4838-beda-da2d71c7b38d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:11.874136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61bdca18-c22f-4838-beda-da2d71c7b38d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:11.874788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61bdca18-c22f-4838-beda-da2d71c7b38d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:12.092062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-43d604eb-bdbc-4cd7-9420-a8ebfcdafe75 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:12.112632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-43d604eb-bdbc-4cd7-9420-a8ebfcdafe75 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1555 microversion: 2.1 time: 0.364633 Apr 21 14:42:12.113539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 233/451] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:11 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1555 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:12.172462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-61bdca18-c22f-4838-beda-da2d71c7b38d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:12.182558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-61bdca18-c22f-4838-beda-da2d71c7b38d tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1502 microversion: 2.1 time: 0.324377 Apr 21 14:42:12.183588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 219/452] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:11 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1502 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:12.886046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:12.886616 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:12.895055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:12.895549 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:12.896414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:12.896895 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:13.132173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:13.135297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a8ba5d80-350c-4310-9028-157aaf6f41bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:13.136294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a8ba5d80-350c-4310-9028-157aaf6f41bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:13.143527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:13.145298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:13.146853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-30797307-16d8-4472-9035-9509f8798cd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.265226 Apr 21 14:42:13.147259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8ba5d80-350c-4310-9028-157aaf6f41bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:13.147443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 234/453] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:12 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:13.148069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8ba5d80-350c-4310-9028-157aaf6f41bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:13.149045 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8ba5d80-350c-4310-9028-157aaf6f41bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:13.149683 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8ba5d80-350c-4310-9028-157aaf6f41bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:13.203315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b69cb657-088e-4938-b930-bc6122bed463 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:13.204114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b69cb657-088e-4938-b930-bc6122bed463 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:13.213787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b69cb657-088e-4938-b930-bc6122bed463 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:13.214675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b69cb657-088e-4938-b930-bc6122bed463 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:13.215828 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b69cb657-088e-4938-b930-bc6122bed463 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:13.216442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b69cb657-088e-4938-b930-bc6122bed463 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:13.389450 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a8ba5d80-350c-4310-9028-157aaf6f41bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:13.399899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a8ba5d80-350c-4310-9028-157aaf6f41bb tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1555 microversion: 2.1 time: 0.270361 Apr 21 14:42:13.400714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 220/454] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:13 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1555 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:13.468044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b69cb657-088e-4938-b930-bc6122bed463 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:13.478664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b69cb657-088e-4938-b930-bc6122bed463 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1502 microversion: 2.1 time: 0.280115 Apr 21 14:42:13.479451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 235/455] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:13 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1502 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:42:14.171099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:14.172152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:14.185165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:14.185822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:14.186860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:14.187470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:14.427251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5651b4b9-5677-4fd3-8bf5-16228b736d83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:14.428573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5651b4b9-5677-4fd3-8bf5-16228b736d83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:14.445507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5651b4b9-5677-4fd3-8bf5-16228b736d83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:14.446529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5651b4b9-5677-4fd3-8bf5-16228b736d83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:14.448272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5651b4b9-5677-4fd3-8bf5-16228b736d83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:14.449210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5651b4b9-5677-4fd3-8bf5-16228b736d83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:14.747011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:14.767293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:14.771309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:14.774732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6d9b2e7b-1999-43c6-b69c-f1047ef98d73 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.607898 Apr 21 14:42:14.775891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 221/456] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:14 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:14.786158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c414d3fd-994e-440a-9f4a-591f01b4be51 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:14.787962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c414d3fd-994e-440a-9f4a-591f01b4be51 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:14.805545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c414d3fd-994e-440a-9f4a-591f01b4be51 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:14.806885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c414d3fd-994e-440a-9f4a-591f01b4be51 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:14.808793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c414d3fd-994e-440a-9f4a-591f01b4be51 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:14.810126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c414d3fd-994e-440a-9f4a-591f01b4be51 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:14.836602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5651b4b9-5677-4fd3-8bf5-16228b736d83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:14.848636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5651b4b9-5677-4fd3-8bf5-16228b736d83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1555 microversion: 2.1 time: 0.430558 Apr 21 14:42:14.862031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 236/457] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:14 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1555 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:15.085000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c414d3fd-994e-440a-9f4a-591f01b4be51 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d29a86cf6f4ce3ac435e37a40d2396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fe7acbedbc48509204223f35d7eba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:15.103858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-ff6e352a-054d-4483-a355-18de0433041c req-16716b03-a173-4e7a-9cbd-9f4c4b880bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f109b33e-030d-4af9-8fdc-0349a03762fe", "name": "network-vif-deleted", "tag": "c502f116-b6a2-4756-ba26-b93734eb54c3"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:15.108591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c414d3fd-994e-440a-9f4a-591f01b4be51 tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 200 len: 1460 microversion: 2.1 time: 0.330718 Apr 21 14:42:15.109720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 222/458] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:14 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 1460 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:15.112984 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:15.112984 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:15.129802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ff6e352a-054d-4483-a355-18de0433041c req-16716b03-a173-4e7a-9cbd-9f4c4b880bc7 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:15.130791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ff6e352a-054d-4483-a355-18de0433041c req-16716b03-a173-4e7a-9cbd-9f4c4b880bc7 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:15.162716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-ff6e352a-054d-4483-a355-18de0433041c req-16716b03-a173-4e7a-9cbd-9f4c4b880bc7 service nova] Creating event network-vif-deleted:c502f116-b6a2-4756-ba26-b93734eb54c3 for instance f109b33e-030d-4af9-8fdc-0349a03762fe on hv-cinder-78638 Apr 21 14:42:15.169554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-ff6e352a-054d-4483-a355-18de0433041c req-16716b03-a173-4e7a-9cbd-9f4c4b880bc7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075131 Apr 21 14:42:15.170782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 237/459] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:42:15.799467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:15.800888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:15.816648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:15.817624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:15.819012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:15.820129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:15.880063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3ce7bb18-40d2-4105-9e2e-c185ca2aa065 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:15.880635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3ce7bb18-40d2-4105-9e2e-c185ca2aa065 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:15.890508 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ce7bb18-40d2-4105-9e2e-c185ca2aa065 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:15.891322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ce7bb18-40d2-4105-9e2e-c185ca2aa065 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:15.892369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ce7bb18-40d2-4105-9e2e-c185ca2aa065 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:15.893062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ce7bb18-40d2-4105-9e2e-c185ca2aa065 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:16.204017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3ce7bb18-40d2-4105-9e2e-c185ca2aa065 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:16.219425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3ce7bb18-40d2-4105-9e2e-c185ca2aa065 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1561 microversion: 2.1 time: 0.343884 Apr 21 14:42:16.220361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 238/460] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:15 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1561 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:16.227146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f95227f6-bafc-4839-8f81-cf4bd9a738ce tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:16.227990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f95227f6-bafc-4839-8f81-cf4bd9a738ce tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] [instance: f109b33e-030d-4af9-8fdc-0349a03762fe] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:16.238743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f95227f6-bafc-4839-8f81-cf4bd9a738ce tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:16.239825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f95227f6-bafc-4839-8f81-cf4bd9a738ce tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:16.240909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f95227f6-bafc-4839-8f81-cf4bd9a738ce tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:16.241595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f95227f6-bafc-4839-8f81-cf4bd9a738ce tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:16.334999 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-f95227f6-bafc-4839-8f81-cf4bd9a738ce tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] HTTP exception thrown: Instance f109b33e-030d-4af9-8fdc-0349a03762fe could not be found. Apr 21 14:42:16.336747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f95227f6-bafc-4839-8f81-cf4bd9a738ce tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] Returning 404 to user: Instance f109b33e-030d-4af9-8fdc-0349a03762fe could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:42:16.338439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f95227f6-bafc-4839-8f81-cf4bd9a738ce tempest-VolumesActionsTest-1312179202 tempest-VolumesActionsTest-1312179202-project] 10.222.0.24 "GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe" status: 404 len: 111 microversion: 2.1 time: 0.116439 Apr 21 14:42:16.339930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 239/461] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:16 2021] GET /compute/v2.1/servers/f109b33e-030d-4af9-8fdc-0349a03762fe => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:42:16.350589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fd9b6d50-eca6-465a-918a-955f991a9d35 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:16.352090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fd9b6d50-eca6-465a-918a-955f991a9d35 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:16.370747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd9b6d50-eca6-465a-918a-955f991a9d35 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:16.372155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd9b6d50-eca6-465a-918a-955f991a9d35 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:16.374191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd9b6d50-eca6-465a-918a-955f991a9d35 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:16.374432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:16.375664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd9b6d50-eca6-465a-918a-955f991a9d35 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:16.410941 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:16.415588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:16.418187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8a4e56c1-ff11-4d0b-828e-ddece4fe810d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.625858 Apr 21 14:42:16.425240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 223/462] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:15 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:16.571318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a8d6c14-3cbe-4c93-9458-6a9015b1d2a4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:16.572555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a8d6c14-3cbe-4c93-9458-6a9015b1d2a4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:16.592733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a8d6c14-3cbe-4c93-9458-6a9015b1d2a4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:16.593239 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a8d6c14-3cbe-4c93-9458-6a9015b1d2a4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:16.594406 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a8d6c14-3cbe-4c93-9458-6a9015b1d2a4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:16.595283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a8d6c14-3cbe-4c93-9458-6a9015b1d2a4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:16.735807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-fd9b6d50-eca6-465a-918a-955f991a9d35 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lazy-loading 'services' on Instance uuid 684834d6-7fa6-4a27-b6cd-56f6c05ac666 {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:42:16.920423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-3a8d6c14-3cbe-4c93-9458-6a9015b1d2a4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lazy-loading 'services' on Instance uuid 7218e5c2-90e5-4d93-94d8-3ac413a54fbb {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:42:17.052133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fd9b6d50-eca6-465a-918a-955f991a9d35 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666/os-volume_attachments/06e9ec9a-2e03-4308-81e7-ae74a95549ff" status: 202 len: 0 microversion: 2.1 time: 0.709655 Apr 21 14:42:17.053457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 240/463] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:42:16 2021] DELETE /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666/os-volume_attachments/06e9ec9a-2e03-4308-81e7-ae74a95549ff => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:42:17.186730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a8d6c14-3cbe-4c93-9458-6a9015b1d2a4 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/os-volume_attachments/984a3c51-dad4-4a91-acdf-f97041b6ed12" status: 202 len: 0 microversion: 2.1 time: 0.623486 Apr 21 14:42:17.187711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 224/464] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:42:16 2021] DELETE /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb/os-volume_attachments/984a3c51-dad4-4a91-acdf-f97041b6ed12 => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:42:17.447237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:17.447985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:17.460551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:17.461181 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:17.461900 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:17.462426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:18.085351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:18.096230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:18.097926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:18.099590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-17005cc9-82a3-48f5-906a-408a582149fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.658888 Apr 21 14:42:18.100440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 241/465] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:17 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:42:19.123641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:19.124357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:19.133696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:19.134244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:19.135117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:19.135597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:19.375430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:19.393999 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:19.397479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:19.399695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e6927625-78d7-4203-8781-6f329b92bc02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.280580 Apr 21 14:42:19.400438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 225/466] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:19 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:20.420357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:20.421083 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:20.431479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:20.432026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:20.433005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:20.433459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:20.680900 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:20.700765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:20.704548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:20.706999 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c386540d-aa06-445c-b294-769dec0a6f81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.290755 Apr 21 14:42:20.708318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 242/467] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:20 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:20.790798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:42:20.791094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:42:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:42:21.744708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:21.746127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:21.763251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:21.764221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:21.765917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:21.766955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:22.098678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:22.109140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:22.110898 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:22.112162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bde2f48e-4d98-45c6-bb5f-b17b4f74be83 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.376510 Apr 21 14:42:22.112796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 226/468] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:21 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:23.133034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:23.133816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:23.146863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:23.147522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:23.148660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:23.149327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:23.381587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:23.392545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:23.394309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:23.395627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a2d44955-5030-4b5d-a462-2a1da2dc11f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.267538 Apr 21 14:42:23.396246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 243/469] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:23 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:24.419098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:24.419794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:24.428728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:24.429230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:24.430094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:24.430580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:24.681431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:24.692769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:24.694621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:24.695984 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3aed79d3-d68f-400b-8d17-0978603e99fe tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.281085 Apr 21 14:42:24.696876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 227/470] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:24 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:25.729615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:25.730615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:25.741061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:25.741780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:25.742704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:25.743202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:25.985060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:26.003895 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:26.007095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:26.009052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c0c74fd1-2bc2-468d-aeab-ed44773697c8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1744 microversion: 2.20 time: 0.283705 Apr 21 14:42:26.010451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 244/471] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:25 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1744 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:27.032379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:27.045931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:27.061914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:27.062749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:27.063787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:27.064428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:27.603438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5951d515-d0f3-4cde-9bbf-84e75440a6ce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:27.604637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5951d515-d0f3-4cde-9bbf-84e75440a6ce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:27.640642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5951d515-d0f3-4cde-9bbf-84e75440a6ce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:27.641049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5951d515-d0f3-4cde-9bbf-84e75440a6ce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:27.641927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5951d515-d0f3-4cde-9bbf-84e75440a6ce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:27.643003 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5951d515-d0f3-4cde-9bbf-84e75440a6ce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:27.670120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:27.711583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:27.716062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:27.718753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3139a5e9-97eb-49c4-9bfd-7720c3d841ef tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1744 microversion: 2.20 time: 0.691522 Apr 21 14:42:27.721572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 228/472] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:27 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1744 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:27.758449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5951d515-d0f3-4cde-9bbf-84e75440a6ce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:42:27.922855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5951d515-d0f3-4cde-9bbf-84e75440a6ce tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 204 len: 0 microversion: 2.1 time: 0.328427 Apr 21 14:42:27.924531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 245/473] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:42:27 2021] DELETE /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:42:27.940810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dd76e69e-8756-4fc5-9812-183f0f1ea1d6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:27.950381 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dd76e69e-8756-4fc5-9812-183f0f1ea1d6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:27.981915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd76e69e-8756-4fc5-9812-183f0f1ea1d6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:27.983360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd76e69e-8756-4fc5-9812-183f0f1ea1d6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:27.985454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd76e69e-8756-4fc5-9812-183f0f1ea1d6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:27.986676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd76e69e-8756-4fc5-9812-183f0f1ea1d6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:28.494702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-f207592a-f9e0-4df9-8a64-8a67da9e4709 req-a3eccd65-adc4-4579-b572-eb93855a6812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf3aa87-b02a-4b58-901a-76f4e825e75a", "name": "network-vif-plugged", "status": "completed", "tag": "245817c6-3c22-47d2-a7ad-82a9d1f0181d"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:28.496630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:28.496630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:28.517892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f207592a-f9e0-4df9-8a64-8a67da9e4709 req-a3eccd65-adc4-4579-b572-eb93855a6812 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:28.518279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f207592a-f9e0-4df9-8a64-8a67da9e4709 req-a3eccd65-adc4-4579-b572-eb93855a6812 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:28.548124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-f207592a-f9e0-4df9-8a64-8a67da9e4709 req-a3eccd65-adc4-4579-b572-eb93855a6812 service nova] Creating event network-vif-plugged:245817c6-3c22-47d2-a7ad-82a9d1f0181d for instance abf3aa87-b02a-4b58-901a-76f4e825e75a on hv-cinder-78638 Apr 21 14:42:28.564084 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-f207592a-f9e0-4df9-8a64-8a67da9e4709 req-a3eccd65-adc4-4579-b572-eb93855a6812 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073920 Apr 21 14:42:28.564816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 246/474] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:42:28.571017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dd76e69e-8756-4fc5-9812-183f0f1ea1d6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:28.585960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dd76e69e-8756-4fc5-9812-183f0f1ea1d6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1515 microversion: 2.1 time: 0.654685 Apr 21 14:42:28.587005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 229/475] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:27 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1515 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:28.744930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:28.745836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:28.758485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:28.759638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:28.761128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:28.762078 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:29.115657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:29.135422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:29.137960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:29.139582 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-026356a4-7db0-4c8b-b356-58de41f11e77 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1744 microversion: 2.20 time: 0.401078 Apr 21 14:42:29.151889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 247/476] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:28 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1744 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:29.606057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-970724d5-8188-4695-b33e-e3861cc9672d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:29.607717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-970724d5-8188-4695-b33e-e3861cc9672d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:29.620285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-970724d5-8188-4695-b33e-e3861cc9672d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:29.620981 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-970724d5-8188-4695-b33e-e3861cc9672d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:29.622602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-970724d5-8188-4695-b33e-e3861cc9672d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:29.623332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-970724d5-8188-4695-b33e-e3861cc9672d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:29.915782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-970724d5-8188-4695-b33e-e3861cc9672d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:29.933475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-970724d5-8188-4695-b33e-e3861cc9672d tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1515 microversion: 2.1 time: 0.331629 Apr 21 14:42:29.942868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 230/477] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:29 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1515 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:30.174610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:30.176070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:30.191727 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:30.192690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:30.194533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:30.195698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:30.492141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7df5b9a4-eebf-4953-afaa-9cf9698d946d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:30.492883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7df5b9a4-eebf-4953-afaa-9cf9698d946d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:30.505657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7df5b9a4-eebf-4953-afaa-9cf9698d946d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:30.506510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7df5b9a4-eebf-4953-afaa-9cf9698d946d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:30.507600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7df5b9a4-eebf-4953-afaa-9cf9698d946d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:30.508276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7df5b9a4-eebf-4953-afaa-9cf9698d946d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:30.533681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:30.545134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:30.546942 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:30.548208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f6f5b1db-f232-47dd-bfd6-1323b200c44b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1744 microversion: 2.20 time: 0.381585 Apr 21 14:42:30.549161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 248/478] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:30 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1744 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:30.604466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7df5b9a4-eebf-4953-afaa-9cf9698d946d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:42:30.760027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7df5b9a4-eebf-4953-afaa-9cf9698d946d tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 204 len: 0 microversion: 2.1 time: 0.271507 Apr 21 14:42:30.760808 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 231/479] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:42:30 2021] DELETE /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 21 14:42:30.769574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88f47d30-eb66-43a3-835c-bf00261cdb43 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:30.770980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-88f47d30-eb66-43a3-835c-bf00261cdb43 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:30.781158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88f47d30-eb66-43a3-835c-bf00261cdb43 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:30.781719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88f47d30-eb66-43a3-835c-bf00261cdb43 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:30.782910 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88f47d30-eb66-43a3-835c-bf00261cdb43 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:30.783440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88f47d30-eb66-43a3-835c-bf00261cdb43 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:30.960459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-db610112-04bf-421d-b015-0645bac41dff tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:30.962082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-db610112-04bf-421d-b015-0645bac41dff tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:30.995696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-db610112-04bf-421d-b015-0645bac41dff tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:30.997818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-db610112-04bf-421d-b015-0645bac41dff tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:31.002328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-db610112-04bf-421d-b015-0645bac41dff tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:31.003783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-db610112-04bf-421d-b015-0645bac41dff tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:31.081543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88f47d30-eb66-43a3-835c-bf00261cdb43 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:31.093630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88f47d30-eb66-43a3-835c-bf00261cdb43 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1509 microversion: 2.1 time: 0.328269 Apr 21 14:42:31.094648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 249/480] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:30 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:42:31.379653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-db610112-04bf-421d-b015-0645bac41dff tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:31.389666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-db610112-04bf-421d-b015-0645bac41dff tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1515 microversion: 2.1 time: 0.439063 Apr 21 14:42:31.390365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 232/481] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:30 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1515 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:31.572628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:31.574787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:31.599450 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:31.600345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:31.601780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:31.602638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:32.113426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:32.117161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-586f9c1a-4d9a-4d73-826d-bf650be0db5e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:32.118332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-586f9c1a-4d9a-4d73-826d-bf650be0db5e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:32.134624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-586f9c1a-4d9a-4d73-826d-bf650be0db5e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:32.135314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-586f9c1a-4d9a-4d73-826d-bf650be0db5e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:32.136319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-586f9c1a-4d9a-4d73-826d-bf650be0db5e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:32.137108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-586f9c1a-4d9a-4d73-826d-bf650be0db5e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:32.151886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:32.157304 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:32.160271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-46f96ab8-1dbf-4b21-a115-751b61d8d58c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1744 microversion: 2.20 time: 0.594128 Apr 21 14:42:32.162081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 250/482] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:31 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1744 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:32.422081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-11e73353-beb9-4897-a12e-f8260e50a672 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:32.423319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-11e73353-beb9-4897-a12e-f8260e50a672 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:32.440086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-11e73353-beb9-4897-a12e-f8260e50a672 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:32.440966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-11e73353-beb9-4897-a12e-f8260e50a672 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:32.442990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-11e73353-beb9-4897-a12e-f8260e50a672 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:32.443867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-11e73353-beb9-4897-a12e-f8260e50a672 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:32.716702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-586f9c1a-4d9a-4d73-826d-bf650be0db5e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:32.729860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-586f9c1a-4d9a-4d73-826d-bf650be0db5e tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1509 microversion: 2.1 time: 0.618675 Apr 21 14:42:32.729860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 233/483] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:32 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1509 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:42:32.919953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-11e73353-beb9-4897-a12e-f8260e50a672 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:32.945063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-11e73353-beb9-4897-a12e-f8260e50a672 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1515 microversion: 2.1 time: 0.535607 Apr 21 14:42:32.946356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 251/484] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:32 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1515 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:33.197383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:33.199078 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:33.216656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:33.217574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:33.218821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:33.219687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:33.763158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-908c5279-a7fe-4e51-b734-d15f36dac63a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:33.767665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-908c5279-a7fe-4e51-b734-d15f36dac63a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:33.805705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-908c5279-a7fe-4e51-b734-d15f36dac63a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:33.806606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-908c5279-a7fe-4e51-b734-d15f36dac63a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:33.808233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-908c5279-a7fe-4e51-b734-d15f36dac63a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:33.809106 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-908c5279-a7fe-4e51-b734-d15f36dac63a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:34.275854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:34.312791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:34.317339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:34.320549 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-40e45f23-d9b3-4a8d-b416-191061404d6a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1744 microversion: 2.20 time: 1.130610 Apr 21 14:42:34.324255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 234/485] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:33 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1744 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:34.344715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c8648a4c-1ac8-4cd7-842a-be8c977c3724 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:34.345607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c8648a4c-1ac8-4cd7-842a-be8c977c3724 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:34.358027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8648a4c-1ac8-4cd7-842a-be8c977c3724 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:34.358858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8648a4c-1ac8-4cd7-842a-be8c977c3724 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:34.360355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8648a4c-1ac8-4cd7-842a-be8c977c3724 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:34.361373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8648a4c-1ac8-4cd7-842a-be8c977c3724 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:34.673374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-908c5279-a7fe-4e51-b734-d15f36dac63a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:34.688607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-908c5279-a7fe-4e51-b734-d15f36dac63a tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1509 microversion: 2.1 time: 0.933721 Apr 21 14:42:34.691672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 252/486] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:33 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1509 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:34.720221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-fe336c71-7501-4e3c-a22b-f8f7d1a72d62 req-618c463f-604b-4519-964f-137e1ae3dc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684834d6-7fa6-4a27-b6cd-56f6c05ac666", "name": "network-vif-deleted", "tag": "83fb07ca-21dd-407f-8495-e12f05bc4735"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:34.722487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:34.722487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:34.733069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-fe336c71-7501-4e3c-a22b-f8f7d1a72d62 req-618c463f-604b-4519-964f-137e1ae3dc3f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:34.733944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-fe336c71-7501-4e3c-a22b-f8f7d1a72d62 req-618c463f-604b-4519-964f-137e1ae3dc3f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:34.762866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-fe336c71-7501-4e3c-a22b-f8f7d1a72d62 req-618c463f-604b-4519-964f-137e1ae3dc3f service nova] Creating event network-vif-deleted:83fb07ca-21dd-407f-8495-e12f05bc4735 for instance 684834d6-7fa6-4a27-b6cd-56f6c05ac666 on hv-cinder-78638 Apr 21 14:42:34.778329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-fe336c71-7501-4e3c-a22b-f8f7d1a72d62 req-618c463f-604b-4519-964f-137e1ae3dc3f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058452 Apr 21 14:42:34.779390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 253/487] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:42:34.951367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c8648a4c-1ac8-4cd7-842a-be8c977c3724 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:35.007914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c8648a4c-1ac8-4cd7-842a-be8c977c3724 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 200 len: 1303 microversion: 2.1 time: 0.663323 Apr 21 14:42:35.019477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 235/488] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:34 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 1303 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:35.374935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:35.376545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:35.403351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:35.407124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:35.409002 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:35.413531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:35.725398 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5e208cfe-50bb-42fd-9673-06b19f20e269 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:35.727421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5e208cfe-50bb-42fd-9673-06b19f20e269 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:35.773468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e208cfe-50bb-42fd-9673-06b19f20e269 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:35.777610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e208cfe-50bb-42fd-9673-06b19f20e269 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:35.784101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e208cfe-50bb-42fd-9673-06b19f20e269 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:35.785588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e208cfe-50bb-42fd-9673-06b19f20e269 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:36.281525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:36.312468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:36.327839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:36.330518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6c8d5489-8800-400b-8213-3f7abc90140b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1739 microversion: 2.20 time: 0.976473 Apr 21 14:42:36.332039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 254/489] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:35 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1739 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:36.343444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f185a2f7-734d-4c77-822b-c7d875e26e3b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:36.356119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f185a2f7-734d-4c77-822b-c7d875e26e3b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 684834d6-7fa6-4a27-b6cd-56f6c05ac666] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:36.387742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f185a2f7-734d-4c77-822b-c7d875e26e3b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:36.388525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f185a2f7-734d-4c77-822b-c7d875e26e3b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:36.393759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f185a2f7-734d-4c77-822b-c7d875e26e3b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:36.394787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f185a2f7-734d-4c77-822b-c7d875e26e3b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:36.641141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-f185a2f7-734d-4c77-822b-c7d875e26e3b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] HTTP exception thrown: Instance 684834d6-7fa6-4a27-b6cd-56f6c05ac666 could not be found. Apr 21 14:42:36.642563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f185a2f7-734d-4c77-822b-c7d875e26e3b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Returning 404 to user: Instance 684834d6-7fa6-4a27-b6cd-56f6c05ac666 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:42:36.644495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f185a2f7-734d-4c77-822b-c7d875e26e3b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666" status: 404 len: 111 microversion: 2.1 time: 0.308381 Apr 21 14:42:36.645727 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 255/490] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:36 2021] GET /compute/v2.1/servers/684834d6-7fa6-4a27-b6cd-56f6c05ac666 => generated 111 bytes in 311 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:42:37.377915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:37.387058 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:37.415955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:37.416760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:37.429556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:37.430209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:37.657751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5e208cfe-50bb-42fd-9673-06b19f20e269 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:37.688820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5e208cfe-50bb-42fd-9673-06b19f20e269 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1509 microversion: 2.1 time: 1.971448 Apr 21 14:42:37.689852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 236/491] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:35 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1509 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:37.919031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:37.977460 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:37.982559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:37.988138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cf333f2b-c1b1-4464-af7c-160e14d4e748 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1739 microversion: 2.20 time: 0.638115 Apr 21 14:42:37.990028 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 256/492] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:37 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1739 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:38.596583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6593c774-ce2f-4958-af4f-29ddd9f830ba tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:38.599987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6593c774-ce2f-4958-af4f-29ddd9f830ba tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:38.638677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6593c774-ce2f-4958-af4f-29ddd9f830ba tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:38.641172 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6593c774-ce2f-4958-af4f-29ddd9f830ba tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:38.646425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6593c774-ce2f-4958-af4f-29ddd9f830ba tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:38.648873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6593c774-ce2f-4958-af4f-29ddd9f830ba tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:38.720444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-17bb4ed2-e6e5-45f3-a5d7-c946dfbbf4c3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:38.727412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-17bb4ed2-e6e5-45f3-a5d7-c946dfbbf4c3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:38.779139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17bb4ed2-e6e5-45f3-a5d7-c946dfbbf4c3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:38.781701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17bb4ed2-e6e5-45f3-a5d7-c946dfbbf4c3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:38.788601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17bb4ed2-e6e5-45f3-a5d7-c946dfbbf4c3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:38.790092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17bb4ed2-e6e5-45f3-a5d7-c946dfbbf4c3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:39.120455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6593c774-ce2f-4958-af4f-29ddd9f830ba tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:42:39.420414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-17bb4ed2-e6e5-45f3-a5d7-c946dfbbf4c3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:39.466687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-17bb4ed2-e6e5-45f3-a5d7-c946dfbbf4c3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 200 len: 1467 microversion: 2.1 time: 0.741167 Apr 21 14:42:39.467942 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 257/493] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:38 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 1467 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:42:39.502122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1236307464", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-482307021", "security_groups": [{"name": "tempest-secgroup-smoke-1254033739"}], "networks": [{"uuid": "a003a337-7cb6-4621-a360-57adf836244c"}], "block_device_mapping_v2": [{"uuid": "2650c932-a57f-4c4f-8360-a85c59803df4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:39.726865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6593c774-ce2f-4958-af4f-29ddd9f830ba tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 204 len: 0 microversion: 2.1 time: 1.140013 Apr 21 14:42:39.734283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 237/494] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:42:38 2021] DELETE /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:42:39.751784 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:39.753155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:39.795636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:39.796551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:39.798239 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:39.803283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:40.096156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] validate_networks() for [('a003a337-7cb6-4621-a360-57adf836244c', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:42:41.079927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:41.096033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:41.097894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:41.099342 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-009b7902-e653-4a3d-9664-e2dec6a8b99f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1739 microversion: 2.20 time: 1.367952 Apr 21 14:42:41.100004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 238/495] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:39 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1739 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:41.130220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-afcdc0dc-b9fe-4019-acf6-4517110b072a req-a7faf36a-7078-4f09-b57b-7a1f452b34ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95fa274-cc0e-4aee-bbc2-4a060be8e4b6", "name": "network-vif-deleted", "tag": "658f52f1-b89f-4063-94df-1cdd4ca78f62"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:41.132248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:41.132248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:41.152608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-afcdc0dc-b9fe-4019-acf6-4517110b072a req-a7faf36a-7078-4f09-b57b-7a1f452b34ff service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:41.153122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-afcdc0dc-b9fe-4019-acf6-4517110b072a req-a7faf36a-7078-4f09-b57b-7a1f452b34ff service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:41.184429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-afcdc0dc-b9fe-4019-acf6-4517110b072a req-a7faf36a-7078-4f09-b57b-7a1f452b34ff service nova] Creating event network-vif-deleted:658f52f1-b89f-4063-94df-1cdd4ca78f62 for instance e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 on hv-cinder-78638 Apr 21 14:42:41.191102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-afcdc0dc-b9fe-4019-acf6-4517110b072a req-a7faf36a-7078-4f09-b57b-7a1f452b34ff service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068556 Apr 21 14:42:41.191886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 239/496] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:42:41.200490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0bbf3d2f-6c46-4461-a410-a067fbf16b75 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:41.201222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0bbf3d2f-6c46-4461-a410-a067fbf16b75 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:41.213769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0bbf3d2f-6c46-4461-a410-a067fbf16b75 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:41.214351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0bbf3d2f-6c46-4461-a410-a067fbf16b75 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:41.215390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0bbf3d2f-6c46-4461-a410-a067fbf16b75 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:41.216539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0bbf3d2f-6c46-4461-a410-a067fbf16b75 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:41.667474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0bbf3d2f-6c46-4461-a410-a067fbf16b75 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:41.702649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0bbf3d2f-6c46-4461-a410-a067fbf16b75 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1514 microversion: 2.1 time: 0.506906 Apr 21 14:42:41.714101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 240/497] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:41 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1514 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:41.719755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fbf397cf-185e-49e8-92d3-99b6d7c30b05 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:41.720477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fbf397cf-185e-49e8-92d3-99b6d7c30b05 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: e95fa274-cc0e-4aee-bbc2-4a060be8e4b6] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:41.745539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbf397cf-185e-49e8-92d3-99b6d7c30b05 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:41.746079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbf397cf-185e-49e8-92d3-99b6d7c30b05 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:41.746969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbf397cf-185e-49e8-92d3-99b6d7c30b05 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:41.747473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbf397cf-185e-49e8-92d3-99b6d7c30b05 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:41.790382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:42:41.791138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:42:41.791899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:42:41.792567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:42:41.793236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:42:41.814831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:41.817740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:41.819096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:41.822705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:41.870414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Getting quotas for project a6d44a65707b47e1b0190ca77b504c5a. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:42:41.873613 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-fbf397cf-185e-49e8-92d3-99b6d7c30b05 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] HTTP exception thrown: Instance e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 could not be found. Apr 21 14:42:41.874336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fbf397cf-185e-49e8-92d3-99b6d7c30b05 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Returning 404 to user: Instance e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:42:41.875474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fbf397cf-185e-49e8-92d3-99b6d7c30b05 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6" status: 404 len: 111 microversion: 2.1 time: 0.160349 Apr 21 14:42:41.876292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 241/498] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:41 2021] GET /compute/v2.1/servers/e95fa274-cc0e-4aee-bbc2-4a060be8e4b6 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:42:41.878317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Getting quotas for user b688274f9d8b4061afbf14e6d4646764 and project a6d44a65707b47e1b0190ca77b504c5a. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:42:41.886824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7099d5c9-d783-42c8-a4db-18f93c8bdc49 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:41.893599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7099d5c9-d783-42c8-a4db-18f93c8bdc49 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:41.910684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7099d5c9-d783-42c8-a4db-18f93c8bdc49 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:41.911448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7099d5c9-d783-42c8-a4db-18f93c8bdc49 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:41.912801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7099d5c9-d783-42c8-a4db-18f93c8bdc49 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:41.913524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7099d5c9-d783-42c8-a4db-18f93c8bdc49 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:42.002300 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7099d5c9-d783-42c8-a4db-18f93c8bdc49 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:42:42.007737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:42:42.011278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2650c932-a57f-4c4f-8360-a85c59803df4',volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:42:42.214470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7099d5c9-d783-42c8-a4db-18f93c8bdc49 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 204 len: 0 microversion: 2.1 time: 0.332165 Apr 21 14:42:42.215368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 242/499] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:42:41 2021] DELETE /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 21 14:42:42.226299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:42.230810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:42.249542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:42.250086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:42.251036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:42.251578 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:42.715780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ac863e2d-75e0-4dae-9834-b8f1721bd328 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.230986 Apr 21 14:42:42.726764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 258/500] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:42:39 2021] POST /compute/v2.1/servers => generated 406 bytes in 3258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:42:42.745612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-53791527-bfe3-4831-a6c0-cf9668ba7c83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:42.751115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-53791527-bfe3-4831-a6c0-cf9668ba7c83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:42.783566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53791527-bfe3-4831-a6c0-cf9668ba7c83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:42.784115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53791527-bfe3-4831-a6c0-cf9668ba7c83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:42.785003 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53791527-bfe3-4831-a6c0-cf9668ba7c83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:42.785512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53791527-bfe3-4831-a6c0-cf9668ba7c83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:43.323390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-53791527-bfe3-4831-a6c0-cf9668ba7c83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:43.345390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-53791527-bfe3-4831-a6c0-cf9668ba7c83 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.610443 Apr 21 14:42:43.350576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 259/501] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:42 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:43.369087 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-afb11b91-b3c7-48f6-9f55-600d059ef4e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:43.376218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-afb11b91-b3c7-48f6-9f55-600d059ef4e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:43.410305 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afb11b91-b3c7-48f6-9f55-600d059ef4e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:43.416745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afb11b91-b3c7-48f6-9f55-600d059ef4e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:43.420754 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afb11b91-b3c7-48f6-9f55-600d059ef4e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:43.428783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afb11b91-b3c7-48f6-9f55-600d059ef4e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:43.913043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-afb11b91-b3c7-48f6-9f55-600d059ef4e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:43.956538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-afb11b91-b3c7-48f6-9f55-600d059ef4e6 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1472 microversion: 2.1 time: 0.597592 Apr 21 14:42:43.972425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 260/502] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:43 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1472 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:44.028709 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e6bc8308-a870-487b-864e-b01d0c157795 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:44.030311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e6bc8308-a870-487b-864e-b01d0c157795 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:44.334058 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e6bc8308-a870-487b-864e-b01d0c157795 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:44.351911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e6bc8308-a870-487b-864e-b01d0c157795 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1088 microversion: 2.1 time: 0.377476 Apr 21 14:42:44.358126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 261/503] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:43 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1088 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:44.374246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5b92092c-7f86-4a5c-b40f-b5779bedfcd7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:44.374940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5b92092c-7f86-4a5c-b40f-b5779bedfcd7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:44.395244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b92092c-7f86-4a5c-b40f-b5779bedfcd7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:44.395990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b92092c-7f86-4a5c-b40f-b5779bedfcd7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:44.396643 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b92092c-7f86-4a5c-b40f-b5779bedfcd7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:44.397129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b92092c-7f86-4a5c-b40f-b5779bedfcd7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:44.686970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5b92092c-7f86-4a5c-b40f-b5779bedfcd7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:44.699917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5b92092c-7f86-4a5c-b40f-b5779bedfcd7 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.333197 Apr 21 14:42:44.706121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 262/504] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:44 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:42:44.720478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-5bb739ac-3c25-4bd2-8b7f-29ca2115a3b7 req-2d8812a7-6052-45f3-af03-06dfd37fdf46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ec6110-d4fc-47b0-98e2-3d3bbd9f277c", "name": "network-vif-deleted", "tag": "bb2772ae-5550-452f-9ef9-fcef3de1a4f8"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:44.725130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:44.725130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:44.742213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-5bb739ac-3c25-4bd2-8b7f-29ca2115a3b7 req-2d8812a7-6052-45f3-af03-06dfd37fdf46 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:44.743034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-5bb739ac-3c25-4bd2-8b7f-29ca2115a3b7 req-2d8812a7-6052-45f3-af03-06dfd37fdf46 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:44.762939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:44.767310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-5bb739ac-3c25-4bd2-8b7f-29ca2115a3b7 req-2d8812a7-6052-45f3-af03-06dfd37fdf46 service nova] Creating event network-vif-deleted:bb2772ae-5550-452f-9ef9-fcef3de1a4f8 for instance 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c on hv-cinder-78638 Apr 21 14:42:44.776573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-5bb739ac-3c25-4bd2-8b7f-29ca2115a3b7 req-2d8812a7-6052-45f3-af03-06dfd37fdf46 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061180 Apr 21 14:42:44.791690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 263/505] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:42:44.799875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:44.805741 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:44.809257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-51d5e360-0ad1-4d8e-98ce-283695a9825a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1739 microversion: 2.20 time: 2.592295 Apr 21 14:42:44.810524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 243/506] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:42 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1739 bytes in 2595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:44.976833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f8e60ebc-e892-4425-af43-2dff63ba9d8f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:44.998178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f8e60ebc-e892-4425-af43-2dff63ba9d8f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:45.044177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8e60ebc-e892-4425-af43-2dff63ba9d8f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:45.047600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8e60ebc-e892-4425-af43-2dff63ba9d8f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:45.049219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8e60ebc-e892-4425-af43-2dff63ba9d8f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:45.050591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8e60ebc-e892-4425-af43-2dff63ba9d8f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:45.333280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f8e60ebc-e892-4425-af43-2dff63ba9d8f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:45.353364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f8e60ebc-e892-4425-af43-2dff63ba9d8f tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1303 microversion: 2.1 time: 0.381528 Apr 21 14:42:45.354000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 264/507] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:44 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1303 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:45.377431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c2d17170-6d7e-4cb3-a4d8-919cd955ba64 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:45.380060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c2d17170-6d7e-4cb3-a4d8-919cd955ba64 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:45.398677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2d17170-6d7e-4cb3-a4d8-919cd955ba64 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:45.399958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2d17170-6d7e-4cb3-a4d8-919cd955ba64 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:45.401918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2d17170-6d7e-4cb3-a4d8-919cd955ba64 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:45.403171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2d17170-6d7e-4cb3-a4d8-919cd955ba64 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:45.737416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-553f7fd5-329d-4026-b9dc-d14fea528ee3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:45.747651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-553f7fd5-329d-4026-b9dc-d14fea528ee3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:45.793455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-553f7fd5-329d-4026-b9dc-d14fea528ee3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:45.803485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-553f7fd5-329d-4026-b9dc-d14fea528ee3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:45.824983 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-553f7fd5-329d-4026-b9dc-d14fea528ee3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:45.825295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c2d17170-6d7e-4cb3-a4d8-919cd955ba64 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:45.848162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c2d17170-6d7e-4cb3-a4d8-919cd955ba64 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1186 microversion: 2.1 time: 0.480927 Apr 21 14:42:45.851048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-553f7fd5-329d-4026-b9dc-d14fea528ee3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:45.853538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 244/508] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:45 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1186 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:45.915230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:45.916627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:45.993664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:45.998882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:46.000588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:46.001505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:46.677322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-553f7fd5-329d-4026-b9dc-d14fea528ee3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:46.710159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-553f7fd5-329d-4026-b9dc-d14fea528ee3 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.980333 Apr 21 14:42:46.714512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 265/509] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:45 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:46.730332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:46.738842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:46.772707 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:46.779462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:46.781744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:46.783050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:47.197448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:47.203166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:47.207237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lazy-loading 'fault' on Instance uuid 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:42:47.387637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:47.431423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:47.435686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:47.438513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-83e27979-c93d-4074-a129-51ce1bd05c66 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1739 microversion: 2.20 time: 1.581045 Apr 21 14:42:47.466603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 245/510] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:45 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1739 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:47.478621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:47.483233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e6314cc-5f26-4e9c-8901-f08dea9a2693 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:47.485721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7e6314cc-5f26-4e9c-8901-f08dea9a2693 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:47.506772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f5701da7-fdb8-4493-9e9b-c537a0948207 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 200 len: 1308 microversion: 2.1 time: 0.789701 Apr 21 14:42:47.507390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e6314cc-5f26-4e9c-8901-f08dea9a2693 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:47.508544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e6314cc-5f26-4e9c-8901-f08dea9a2693 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:47.510624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e6314cc-5f26-4e9c-8901-f08dea9a2693 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:47.511857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e6314cc-5f26-4e9c-8901-f08dea9a2693 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:47.534058 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 266/511] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:46 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 1308 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:47.735088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ba31a51-59af-4709-9739-41e39dd45c8c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:47.741945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2ba31a51-59af-4709-9739-41e39dd45c8c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:47.781526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ba31a51-59af-4709-9739-41e39dd45c8c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:47.783013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ba31a51-59af-4709-9739-41e39dd45c8c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:47.784879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ba31a51-59af-4709-9739-41e39dd45c8c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:47.786538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ba31a51-59af-4709-9739-41e39dd45c8c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:47.924910 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7e6314cc-5f26-4e9c-8901-f08dea9a2693 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:48.016611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7e6314cc-5f26-4e9c-8901-f08dea9a2693 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1204 microversion: 2.1 time: 0.529562 Apr 21 14:42:48.026368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 246/512] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:47 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1204 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:48.490634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:48.491767 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:48.534427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:48.546753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:48.559319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:48.560340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:48.594681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ba31a51-59af-4709-9739-41e39dd45c8c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:48.620524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ba31a51-59af-4709-9739-41e39dd45c8c tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.893222 Apr 21 14:42:48.634650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 267/513] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:47 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:48.655294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-13089f13-f98a-4772-8c7c-b03635896d64 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:48.657254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-13089f13-f98a-4772-8c7c-b03635896d64 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:48.691668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13089f13-f98a-4772-8c7c-b03635896d64 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:48.693060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13089f13-f98a-4772-8c7c-b03635896d64 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:48.697294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13089f13-f98a-4772-8c7c-b03635896d64 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:48.698733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13089f13-f98a-4772-8c7c-b03635896d64 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:48.949181 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-13089f13-f98a-4772-8c7c-b03635896d64 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] HTTP exception thrown: Instance 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c could not be found. Apr 21 14:42:48.960988 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-13089f13-f98a-4772-8c7c-b03635896d64 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Returning 404 to user: Instance 68ec6110-d4fc-47b0-98e2-3d3bbd9f277c could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:42:48.979753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-13089f13-f98a-4772-8c7c-b03635896d64 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c" status: 404 len: 111 microversion: 2.1 time: 0.342579 Apr 21 14:42:48.990535 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 268/514] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:48 2021] GET /compute/v2.1/servers/68ec6110-d4fc-47b0-98e2-3d3bbd9f277c => generated 111 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:42:49.025256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-deb972ad-fa69-4d9f-b859-727220f71e0a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:49.026412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-deb972ad-fa69-4d9f-b859-727220f71e0a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:49.057761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-deb972ad-fa69-4d9f-b859-727220f71e0a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:49.058648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-deb972ad-fa69-4d9f-b859-727220f71e0a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:49.060246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-deb972ad-fa69-4d9f-b859-727220f71e0a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:49.061059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-deb972ad-fa69-4d9f-b859-727220f71e0a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:49.405266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-deb972ad-fa69-4d9f-b859-727220f71e0a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:42:49.949515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-deb972ad-fa69-4d9f-b859-727220f71e0a tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 204 len: 0 microversion: 2.1 time: 0.956634 Apr 21 14:42:49.955189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 269/515] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:42:48 2021] DELETE /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:42:49.964453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dc0dad64-96dd-44ce-b725-10b55336e79d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:49.966104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dc0dad64-96dd-44ce-b725-10b55336e79d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:49.997677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc0dad64-96dd-44ce-b725-10b55336e79d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:49.998632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc0dad64-96dd-44ce-b725-10b55336e79d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:50.000166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc0dad64-96dd-44ce-b725-10b55336e79d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:50.001171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc0dad64-96dd-44ce-b725-10b55336e79d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:50.614777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dc0dad64-96dd-44ce-b725-10b55336e79d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:50.634846 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dc0dad64-96dd-44ce-b725-10b55336e79d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 0.676609 Apr 21 14:42:50.636304 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 270/516] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:49 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:50.654559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c0436c5b-c062-4bf3-9baa-7794d3a84d21 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:50.655817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c0436c5b-c062-4bf3-9baa-7794d3a84d21 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:50.688642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0436c5b-c062-4bf3-9baa-7794d3a84d21 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:50.689567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0436c5b-c062-4bf3-9baa-7794d3a84d21 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:50.691233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0436c5b-c062-4bf3-9baa-7794d3a84d21 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:50.692246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0436c5b-c062-4bf3-9baa-7794d3a84d21 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:50.966579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:50.994960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:51.004521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:51.022106 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-823c7015-2db7-4934-9746-6af5cadf6fda tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1739 microversion: 2.20 time: 2.523637 Apr 21 14:42:51.023185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 247/517] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:48 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1739 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:51.040813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d37d01b6-7e7f-4db1-9fd7-e6c87002cf0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:51.041541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d37d01b6-7e7f-4db1-9fd7-e6c87002cf0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:51.079332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d37d01b6-7e7f-4db1-9fd7-e6c87002cf0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:51.079809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d37d01b6-7e7f-4db1-9fd7-e6c87002cf0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:51.080700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d37d01b6-7e7f-4db1-9fd7-e6c87002cf0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:51.081203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d37d01b6-7e7f-4db1-9fd7-e6c87002cf0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:51.274230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c0436c5b-c062-4bf3-9baa-7794d3a84d21 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:51.299891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c0436c5b-c062-4bf3-9baa-7794d3a84d21 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.662204 Apr 21 14:42:51.312752 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 271/518] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:50 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:51.670602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3c290907-c2d6-4529-998e-00ac73ad0211 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:51.678524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3c290907-c2d6-4529-998e-00ac73ad0211 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:51.691835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c290907-c2d6-4529-998e-00ac73ad0211 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:51.694295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c290907-c2d6-4529-998e-00ac73ad0211 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:51.695791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c290907-c2d6-4529-998e-00ac73ad0211 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:51.696593 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c290907-c2d6-4529-998e-00ac73ad0211 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:52.181323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3c290907-c2d6-4529-998e-00ac73ad0211 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:52.251211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3c290907-c2d6-4529-998e-00ac73ad0211 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 0.584788 Apr 21 14:42:52.278447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 272/519] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:51 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:52.301290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:52.302061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:52.326051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:52.326579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:52.327474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:52.327979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:52.695162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d37d01b6-7e7f-4db1-9fd7-e6c87002cf0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:52.777154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d37d01b6-7e7f-4db1-9fd7-e6c87002cf0e tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1514 microversion: 2.1 time: 1.742473 Apr 21 14:42:52.777154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 248/520] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:51 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1514 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:52.809870 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9cdc1d50-fc8b-43fa-8acf-ab83c8770b07 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:52.810856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9cdc1d50-fc8b-43fa-8acf-ab83c8770b07 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:52.868458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9cdc1d50-fc8b-43fa-8acf-ab83c8770b07 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:52.869313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9cdc1d50-fc8b-43fa-8acf-ab83c8770b07 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:52.887223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9cdc1d50-fc8b-43fa-8acf-ab83c8770b07 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:52.888073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9cdc1d50-fc8b-43fa-8acf-ab83c8770b07 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:54.323369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:54.349775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:54.351841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:54.358901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-610be2cb-e576-46d6-a02a-53b2a88bf6f5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1739 microversion: 2.20 time: 2.073870 Apr 21 14:42:54.359687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 273/521] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:52 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1739 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:54.380332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a5e8bd71-8540-44a9-857c-5066b21b41dc req-f1d709cc-af27-4285-ad3e-faf53848c2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7218e5c2-90e5-4d93-94d8-3ac413a54fbb", "name": "network-vif-unplugged", "status": "completed", "tag": "789cafbf-6ab1-45fb-a401-fa6d24cd4994"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:54.383399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:54.383399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:54.424343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a5e8bd71-8540-44a9-857c-5066b21b41dc req-f1d709cc-af27-4285-ad3e-faf53848c2fd service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:54.425599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a5e8bd71-8540-44a9-857c-5066b21b41dc req-f1d709cc-af27-4285-ad3e-faf53848c2fd service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:54.505938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9cdc1d50-fc8b-43fa-8acf-ab83c8770b07 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:54.516209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a5e8bd71-8540-44a9-857c-5066b21b41dc req-f1d709cc-af27-4285-ad3e-faf53848c2fd service nova] Creating event network-vif-unplugged:789cafbf-6ab1-45fb-a401-fa6d24cd4994 for instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb on hv-cinder-78638 Apr 21 14:42:54.538738 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9cdc1d50-fc8b-43fa-8acf-ab83c8770b07 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 1.756385 Apr 21 14:42:54.540462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 249/522] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:52 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:54.544510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a5e8bd71-8540-44a9-857c-5066b21b41dc req-f1d709cc-af27-4285-ad3e-faf53848c2fd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182056 Apr 21 14:42:54.546087 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 274/523] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:42:54.568798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-05a5b68e-a09e-4614-be26-3527273794c6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:54.570657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-05a5b68e-a09e-4614-be26-3527273794c6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:54.575820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6983a4b0-e526-4a7f-9124-4b50b835edaa tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:54.577420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6983a4b0-e526-4a7f-9124-4b50b835edaa tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:54.602534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05a5b68e-a09e-4614-be26-3527273794c6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:54.604760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6983a4b0-e526-4a7f-9124-4b50b835edaa tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:54.607309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05a5b68e-a09e-4614-be26-3527273794c6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:54.611461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05a5b68e-a09e-4614-be26-3527273794c6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:54.615161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05a5b68e-a09e-4614-be26-3527273794c6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:54.616220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6983a4b0-e526-4a7f-9124-4b50b835edaa tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:54.617196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6983a4b0-e526-4a7f-9124-4b50b835edaa tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:54.617726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6983a4b0-e526-4a7f-9124-4b50b835edaa tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:55.438702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6983a4b0-e526-4a7f-9124-4b50b835edaa tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:55.449341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6983a4b0-e526-4a7f-9124-4b50b835edaa tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 200 len: 1472 microversion: 2.1 time: 0.901453 Apr 21 14:42:55.460309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 275/524] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:54 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 1472 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:55.465711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:55.466440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:55.477250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:55.477688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:55.478686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:55.479319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:55.872107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:55.897337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:55.902507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:55.905929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-26f9b662-fc2e-4a9a-aff8-324e4f1206e1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1721 microversion: 2.20 time: 0.443878 Apr 21 14:42:55.907606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 276/525] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:55 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1721 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:42:55.918817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-c725bc4b-919b-4dfb-a682-0c16da4dc3bf req-33d2ab02-d466-40b6-9bb1-be8e2f618304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7219388-ce17-45a3-b762-ddb8f62f57d4", "name": "network-vif-deleted", "tag": "c8eaff5b-4a42-4389-bc4b-1592ce5859e2"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:55.923649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:55.923649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:55.945907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c725bc4b-919b-4dfb-a682-0c16da4dc3bf req-33d2ab02-d466-40b6-9bb1-be8e2f618304 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:55.947543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c725bc4b-919b-4dfb-a682-0c16da4dc3bf req-33d2ab02-d466-40b6-9bb1-be8e2f618304 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:56.098820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-c725bc4b-919b-4dfb-a682-0c16da4dc3bf req-33d2ab02-d466-40b6-9bb1-be8e2f618304 service nova] Creating event network-vif-deleted:c8eaff5b-4a42-4389-bc4b-1592ce5859e2 for instance d7219388-ce17-45a3-b762-ddb8f62f57d4 on hv-cinder-78638 Apr 21 14:42:56.133366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-c725bc4b-919b-4dfb-a682-0c16da4dc3bf req-33d2ab02-d466-40b6-9bb1-be8e2f618304 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222805 Apr 21 14:42:56.136495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 277/526] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:42:56.149181 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b6bbf8cc-1ea4-409e-9dcd-4952e7c33608 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:56.151378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b6bbf8cc-1ea4-409e-9dcd-4952e7c33608 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:56.185252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6bbf8cc-1ea4-409e-9dcd-4952e7c33608 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:56.185252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6bbf8cc-1ea4-409e-9dcd-4952e7c33608 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:56.185963 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6bbf8cc-1ea4-409e-9dcd-4952e7c33608 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:56.186521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6bbf8cc-1ea4-409e-9dcd-4952e7c33608 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:56.624358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6bbf8cc-1ea4-409e-9dcd-4952e7c33608 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:56.634356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b6bbf8cc-1ea4-409e-9dcd-4952e7c33608 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1521 microversion: 2.1 time: 0.496337 Apr 21 14:42:56.635320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 278/527] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:56 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:56.641489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-7f9c4f9c-2349-4a04-84b3-4762a51beb34 req-fd005e13-72ce-4da9-9737-9de9255da064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ad6998-eddd-4b1f-b1f8-adada36a72a7", "tag": "cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:56.643320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:56.643320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:56.654017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7f9c4f9c-2349-4a04-84b3-4762a51beb34 req-fd005e13-72ce-4da9-9737-9de9255da064 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:56.654524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7f9c4f9c-2349-4a04-84b3-4762a51beb34 req-fd005e13-72ce-4da9-9737-9de9255da064 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:56.677027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-7f9c4f9c-2349-4a04-84b3-4762a51beb34 req-fd005e13-72ce-4da9-9737-9de9255da064 service nova] Creating event network-changed:cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7 for instance 96ad6998-eddd-4b1f-b1f8-adada36a72a7 on hv-cinder-78638 Apr 21 14:42:56.682712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-7f9c4f9c-2349-4a04-84b3-4762a51beb34 req-fd005e13-72ce-4da9-9737-9de9255da064 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045197 Apr 21 14:42:56.683589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 279/528] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:42:56.689186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3034464-c39b-4cf1-92f4-deec02a5745b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:56.689967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a3034464-c39b-4cf1-92f4-deec02a5745b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: d7219388-ce17-45a3-b762-ddb8f62f57d4] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:56.700123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3034464-c39b-4cf1-92f4-deec02a5745b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:56.700786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3034464-c39b-4cf1-92f4-deec02a5745b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:56.701815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3034464-c39b-4cf1-92f4-deec02a5745b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:56.702377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3034464-c39b-4cf1-92f4-deec02a5745b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:56.764967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-a3034464-c39b-4cf1-92f4-deec02a5745b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] HTTP exception thrown: Instance d7219388-ce17-45a3-b762-ddb8f62f57d4 could not be found. Apr 21 14:42:56.765662 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3034464-c39b-4cf1-92f4-deec02a5745b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Returning 404 to user: Instance d7219388-ce17-45a3-b762-ddb8f62f57d4 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:42:56.766662 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a3034464-c39b-4cf1-92f4-deec02a5745b tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4" status: 404 len: 111 microversion: 2.1 time: 0.082100 Apr 21 14:42:56.767374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 280/529] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:56 2021] GET /compute/v2.1/servers/d7219388-ce17-45a3-b762-ddb8f62f57d4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:42:56.929511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:56.931337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:56.949560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:56.950209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:56.951363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:56.954113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:57.269412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:57.290443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:57.294151 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:57.298294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f22888b-96e6-4918-93c7-a9bd8761a634 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1721 microversion: 2.20 time: 0.372932 Apr 21 14:42:57.310828 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 281/530] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:56 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1721 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:42:57.364707 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-05a5b68e-a09e-4614-be26-3527273794c6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:57.381164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-05a5b68e-a09e-4614-be26-3527273794c6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 2.833355 Apr 21 14:42:57.382537 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 250/531] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:54 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 2837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:57.663011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1f031c59-bd71-4d76-bf5f-ec732481ea93 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:57.663884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1f031c59-bd71-4d76-bf5f-ec732481ea93 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:57.675742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f031c59-bd71-4d76-bf5f-ec732481ea93 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:57.676636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f031c59-bd71-4d76-bf5f-ec732481ea93 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:57.677861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f031c59-bd71-4d76-bf5f-ec732481ea93 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:57.678567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f031c59-bd71-4d76-bf5f-ec732481ea93 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:57.897090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1f031c59-bd71-4d76-bf5f-ec732481ea93 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c17c00177d754342b2919b68a3f9df93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fbd46f910d42d1975f143a55e34822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:57.909625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1f031c59-bd71-4d76-bf5f-ec732481ea93 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 200 len: 1479 microversion: 2.1 time: 0.250628 Apr 21 14:42:57.918075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 282/532] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:57 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 1479 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:58.303928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e5679f2d-ace5-4ae2-b86f-c5c4b9c35aa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:58.305699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e5679f2d-ace5-4ae2-b86f-c5c4b9c35aa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:58.325097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5679f2d-ace5-4ae2-b86f-c5c4b9c35aa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:58.326526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5679f2d-ace5-4ae2-b86f-c5c4b9c35aa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:58.328384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5679f2d-ace5-4ae2-b86f-c5c4b9c35aa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:58.330246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5679f2d-ace5-4ae2-b86f-c5c4b9c35aa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:58.334386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:58.338565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:58.371406 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:58.374443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:58.381281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:58.382501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:58.463647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e5679f2d-ace5-4ae2-b86f-c5c4b9c35aa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:42:58.709448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e5679f2d-ace5-4ae2-b86f-c5c4b9c35aa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 204 len: 0 microversion: 2.1 time: 0.406098 Apr 21 14:42:58.711801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 251/533] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:42:58 2021] DELETE /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:42:58.730715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ca3fe567-c3ed-4a0e-b3cc-5ed8bcb8dc65 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:58.732591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ca3fe567-c3ed-4a0e-b3cc-5ed8bcb8dc65 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:58.750063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca3fe567-c3ed-4a0e-b3cc-5ed8bcb8dc65 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:58.751070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca3fe567-c3ed-4a0e-b3cc-5ed8bcb8dc65 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:58.752986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca3fe567-c3ed-4a0e-b3cc-5ed8bcb8dc65 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:58.755186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca3fe567-c3ed-4a0e-b3cc-5ed8bcb8dc65 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:59.014256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:59.039848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:59.046177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:59.049038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c543d29d-d6cb-4e3b-a5db-905f773900a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1721 microversion: 2.20 time: 0.722914 Apr 21 14:42:59.051000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 283/534] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:42:58 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1721 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:42:59.061461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1f8c190b-e4f3-4740-9e06-4e5bc9bf3255 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:59.070950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1f8c190b-e4f3-4740-9e06-4e5bc9bf3255 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:59.102845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f8c190b-e4f3-4740-9e06-4e5bc9bf3255 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:59.104511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f8c190b-e4f3-4740-9e06-4e5bc9bf3255 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:59.107304 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f8c190b-e4f3-4740-9e06-4e5bc9bf3255 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:59.108449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f8c190b-e4f3-4740-9e06-4e5bc9bf3255 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:59.531082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1f8c190b-e4f3-4740-9e06-4e5bc9bf3255 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:59.541743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1f8c190b-e4f3-4740-9e06-4e5bc9bf3255 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1515 microversion: 2.1 time: 0.488596 Apr 21 14:42:59.554332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 284/535] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:59 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1515 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:59.554332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-4aadec6a-7729-4a62-aa1f-17fa008c6499 req-16b32f88-703d-4dda-89cc-a40eb714cb97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7218e5c2-90e5-4d93-94d8-3ac413a54fbb", "name": "network-vif-deleted", "tag": "789cafbf-6ab1-45fb-a401-fa6d24cd4994"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:59.554332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:59.554332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:59.562751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-4aadec6a-7729-4a62-aa1f-17fa008c6499 req-16b32f88-703d-4dda-89cc-a40eb714cb97 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:59.563525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-4aadec6a-7729-4a62-aa1f-17fa008c6499 req-16b32f88-703d-4dda-89cc-a40eb714cb97 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:59.592134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-4aadec6a-7729-4a62-aa1f-17fa008c6499 req-16b32f88-703d-4dda-89cc-a40eb714cb97 service nova] Creating event network-vif-deleted:789cafbf-6ab1-45fb-a401-fa6d24cd4994 for instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb on hv-cinder-78638 Apr 21 14:42:59.604869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-4aadec6a-7729-4a62-aa1f-17fa008c6499 req-16b32f88-703d-4dda-89cc-a40eb714cb97 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060174 Apr 21 14:42:59.606224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 285/536] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:42:59.618134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-d667bd6c-7389-4508-b0d0-1518c18933c0 req-80ada722-f8a1-4d97-92c6-e3db07ae8f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf3aa87-b02a-4b58-901a-76f4e825e75a", "name": "network-vif-unplugged", "status": "completed", "tag": "245817c6-3c22-47d2-a7ad-82a9d1f0181d"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:42:59.621289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:42:59.621289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:42:59.631935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d667bd6c-7389-4508-b0d0-1518c18933c0 req-80ada722-f8a1-4d97-92c6-e3db07ae8f0b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:59.632515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d667bd6c-7389-4508-b0d0-1518c18933c0 req-80ada722-f8a1-4d97-92c6-e3db07ae8f0b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:59.651993 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-d667bd6c-7389-4508-b0d0-1518c18933c0 req-80ada722-f8a1-4d97-92c6-e3db07ae8f0b service nova] Creating event network-vif-unplugged:245817c6-3c22-47d2-a7ad-82a9d1f0181d for instance abf3aa87-b02a-4b58-901a-76f4e825e75a on hv-cinder-78638 Apr 21 14:42:59.658960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-d667bd6c-7389-4508-b0d0-1518c18933c0 req-80ada722-f8a1-4d97-92c6-e3db07ae8f0b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048688 Apr 21 14:42:59.660654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 286/537] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:42:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:42:59.676496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b49972cd-3b0e-4695-bbee-2458716cc789 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:42:59.677935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b49972cd-3b0e-4695-bbee-2458716cc789 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] [instance: 7218e5c2-90e5-4d93-94d8-3ac413a54fbb] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:42:59.694866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b49972cd-3b0e-4695-bbee-2458716cc789 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:59.695879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b49972cd-3b0e-4695-bbee-2458716cc789 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:59.697891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b49972cd-3b0e-4695-bbee-2458716cc789 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:42:59.698829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b49972cd-3b0e-4695-bbee-2458716cc789 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:42:59.772229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca3fe567-c3ed-4a0e-b3cc-5ed8bcb8dc65 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:42:59.795317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ca3fe567-c3ed-4a0e-b3cc-5ed8bcb8dc65 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 1.075272 Apr 21 14:42:59.796879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 252/538] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:58 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:42:59.826438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-b49972cd-3b0e-4695-bbee-2458716cc789 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] HTTP exception thrown: Instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb could not be found. Apr 21 14:42:59.826438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b49972cd-3b0e-4695-bbee-2458716cc789 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] Returning 404 to user: Instance 7218e5c2-90e5-4d93-94d8-3ac413a54fbb could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:42:59.827425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b49972cd-3b0e-4695-bbee-2458716cc789 tempest-ServerRescueNegativeTestJSON-1679629539 tempest-ServerRescueNegativeTestJSON-1679629539-project] 10.222.0.24 "GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb" status: 404 len: 111 microversion: 2.1 time: 0.160862 Apr 21 14:42:59.828867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 287/539] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:42:59 2021] GET /compute/v2.1/servers/7218e5c2-90e5-4d93-94d8-3ac413a54fbb => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:43:00.084793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:00.086394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:00.102277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:00.103363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:00.104753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:00.105790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:00.514155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:00.524868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:00.526649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:00.527902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d1b6854e-473c-41a5-ad73-deefb908d50b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1721 microversion: 2.20 time: 0.451667 Apr 21 14:43:00.528562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 253/540] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:00 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1721 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:00.575370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ca63eff3-efe7-4f02-93d5-1fa8b0cd29ea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:00.576018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ca63eff3-efe7-4f02-93d5-1fa8b0cd29ea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:00.584210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca63eff3-efe7-4f02-93d5-1fa8b0cd29ea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:00.584714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca63eff3-efe7-4f02-93d5-1fa8b0cd29ea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:00.585557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca63eff3-efe7-4f02-93d5-1fa8b0cd29ea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:00.586025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca63eff3-efe7-4f02-93d5-1fa8b0cd29ea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:00.825201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-36b9fce7-5b17-4a3a-a7b9-99522a316961 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:00.826072 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-36b9fce7-5b17-4a3a-a7b9-99522a316961 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:00.851254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36b9fce7-5b17-4a3a-a7b9-99522a316961 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:00.851956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36b9fce7-5b17-4a3a-a7b9-99522a316961 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:00.853240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36b9fce7-5b17-4a3a-a7b9-99522a316961 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:00.854069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36b9fce7-5b17-4a3a-a7b9-99522a316961 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:01.043558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca63eff3-efe7-4f02-93d5-1fa8b0cd29ea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:01.057876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ca63eff3-efe7-4f02-93d5-1fa8b0cd29ea tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1515 microversion: 2.1 time: 0.486415 Apr 21 14:43:01.059501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 288/541] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:00 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1515 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:01.548427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:01.551526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:01.563323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:01.564187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:01.565432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:01.566399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:01.779683 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-36b9fce7-5b17-4a3a-a7b9-99522a316961 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:01.790087 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-36b9fce7-5b17-4a3a-a7b9-99522a316961 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 0.969001 Apr 21 14:43:01.791326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 254/542] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:00 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:02.088745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c4b1f185-0ef2-4ab5-8935-d1ab50ddfaa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:02.090205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c4b1f185-0ef2-4ab5-8935-d1ab50ddfaa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:02.099888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4b1f185-0ef2-4ab5-8935-d1ab50ddfaa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:02.100376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4b1f185-0ef2-4ab5-8935-d1ab50ddfaa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:02.101929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4b1f185-0ef2-4ab5-8935-d1ab50ddfaa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:02.102654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4b1f185-0ef2-4ab5-8935-d1ab50ddfaa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:02.328576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c4b1f185-0ef2-4ab5-8935-d1ab50ddfaa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4c490791d14d0981977c2544a8f9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273beec5c4c4f89a4c7c896497de7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:02.339150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c4b1f185-0ef2-4ab5-8935-d1ab50ddfaa2 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 200 len: 1473 microversion: 2.1 time: 0.254555 Apr 21 14:43:02.340122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 255/543] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:02 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 1473 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:43:02.416629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-0d3bc621-00dc-4fba-9e31-12b2bee5aa0b req-553494c0-af03-4d4f-aade-2a9564314de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502a82df-ee66-408d-ab9e-8207516c0415", "name": "network-vif-deleted", "tag": "e2c31a01-40a4-4b6e-aaee-cbeb1067272f"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:02.419977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:43:02.419977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:43:02.451653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0d3bc621-00dc-4fba-9e31-12b2bee5aa0b req-553494c0-af03-4d4f-aade-2a9564314de3 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:02.453744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0d3bc621-00dc-4fba-9e31-12b2bee5aa0b req-553494c0-af03-4d4f-aade-2a9564314de3 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:02.540686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-0d3bc621-00dc-4fba-9e31-12b2bee5aa0b req-553494c0-af03-4d4f-aade-2a9564314de3 service nova] Creating event network-vif-deleted:e2c31a01-40a4-4b6e-aaee-cbeb1067272f for instance 502a82df-ee66-408d-ab9e-8207516c0415 on hv-cinder-78638 Apr 21 14:43:02.553960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-0d3bc621-00dc-4fba-9e31-12b2bee5aa0b req-553494c0-af03-4d4f-aade-2a9564314de3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141950 Apr 21 14:43:02.556244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 256/544] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:43:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:02.623742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:02.635033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:02.636826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:02.638172 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ae60e681-00ed-4b88-bd4c-fe79064079e4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1724 microversion: 2.20 time: 1.094431 Apr 21 14:43:02.650130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 289/545] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:01 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1724 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:02.668568 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0e39e1d3-a033-444b-855e-4251555610af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75abcebc-7a80-4cc5-abf6-6f4b8aad63be"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:02.670071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0e39e1d3-a033-444b-855e-4251555610af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:02.683322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e39e1d3-a033-444b-855e-4251555610af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:02.684017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e39e1d3-a033-444b-855e-4251555610af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:02.685004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e39e1d3-a033-444b-855e-4251555610af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:02.685509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e39e1d3-a033-444b-855e-4251555610af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:02.809700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-098b0b3d-577f-4a7d-8b1f-6ca80ea4d15d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:02.811044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-098b0b3d-577f-4a7d-8b1f-6ca80ea4d15d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:02.820855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-098b0b3d-577f-4a7d-8b1f-6ca80ea4d15d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:02.822025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-098b0b3d-577f-4a7d-8b1f-6ca80ea4d15d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:02.823836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-098b0b3d-577f-4a7d-8b1f-6ca80ea4d15d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:02.824618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-098b0b3d-577f-4a7d-8b1f-6ca80ea4d15d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:03.434419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0e39e1d3-a033-444b-855e-4251555610af tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.769901 Apr 21 14:43:03.436003 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 257/546] 10.222.0.24 () {62 vars in 1354 bytes} [Wed Apr 21 14:43:02 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/os-volume_attachments => generated 188 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:43:03.451810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-70a92d7f-0636-42e8-8713-22539e8fb494 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:03.453312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-70a92d7f-0636-42e8-8713-22539e8fb494 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] [instance: 502a82df-ee66-408d-ab9e-8207516c0415] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:03.467782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70a92d7f-0636-42e8-8713-22539e8fb494 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:03.469360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70a92d7f-0636-42e8-8713-22539e8fb494 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:03.470504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70a92d7f-0636-42e8-8713-22539e8fb494 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:03.471103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70a92d7f-0636-42e8-8713-22539e8fb494 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:03.576091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-70a92d7f-0636-42e8-8713-22539e8fb494 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] HTTP exception thrown: Instance 502a82df-ee66-408d-ab9e-8207516c0415 could not be found. Apr 21 14:43:03.577412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-70a92d7f-0636-42e8-8713-22539e8fb494 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] Returning 404 to user: Instance 502a82df-ee66-408d-ab9e-8207516c0415 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:43:03.579302 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-70a92d7f-0636-42e8-8713-22539e8fb494 tempest-AttachVolumeNegativeTest-219833645 tempest-AttachVolumeNegativeTest-219833645-project] 10.222.0.24 "GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415" status: 404 len: 111 microversion: 2.1 time: 0.139871 Apr 21 14:43:03.581619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 258/547] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:03 2021] GET /compute/v2.1/servers/502a82df-ee66-408d-ab9e-8207516c0415 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:43:03.648735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6b4686bb-3f1d-4488-8eda-48b442f045d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:03.649382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6b4686bb-3f1d-4488-8eda-48b442f045d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:03.658687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6b4686bb-3f1d-4488-8eda-48b442f045d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:03.659187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6b4686bb-3f1d-4488-8eda-48b442f045d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:03.662594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-098b0b3d-577f-4a7d-8b1f-6ca80ea4d15d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:03.666780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6b4686bb-3f1d-4488-8eda-48b442f045d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:03.669164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6b4686bb-3f1d-4488-8eda-48b442f045d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:03.673259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-098b0b3d-577f-4a7d-8b1f-6ca80ea4d15d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 0.867664 Apr 21 14:43:03.674505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 290/548] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:02 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:03.870248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6b4686bb-3f1d-4488-8eda-48b442f045d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action" status: 202 len: 0 microversion: 2.20 time: 0.225400 Apr 21 14:43:03.888154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 259/549] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:43:03 2021] POST /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 21 14:43:03.889680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:03.891308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:03.907217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:03.909057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:03.911056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:03.912279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:04.653133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:04.685178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:04.690024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:04.706740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7023e794-061e-4c51-8916-df4d408d221b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1750 microversion: 2.20 time: 0.826753 Apr 21 14:43:04.707588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-33189c44-b401-48dd-816d-b1263a3ecee7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:04.709429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-33189c44-b401-48dd-816d-b1263a3ecee7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:04.711366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 291/550] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:03 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1750 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:04.753522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33189c44-b401-48dd-816d-b1263a3ecee7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:04.755495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33189c44-b401-48dd-816d-b1263a3ecee7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:04.757596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33189c44-b401-48dd-816d-b1263a3ecee7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:04.758998 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33189c44-b401-48dd-816d-b1263a3ecee7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:05.494553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-33189c44-b401-48dd-816d-b1263a3ecee7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:05.534216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-33189c44-b401-48dd-816d-b1263a3ecee7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 0.838772 Apr 21 14:43:05.536399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 260/551] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:04 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:05.754975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:05.757723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:05.774638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:05.776024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:05.778101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:05.779352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:06.562163 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fee70267-8682-4137-b817-97277270d1e6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:06.563929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fee70267-8682-4137-b817-97277270d1e6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:06.589481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fee70267-8682-4137-b817-97277270d1e6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:06.590621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fee70267-8682-4137-b817-97277270d1e6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:06.592120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fee70267-8682-4137-b817-97277270d1e6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:06.595166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fee70267-8682-4137-b817-97277270d1e6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:07.437638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:07.480577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:07.488637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:07.491669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-13f4f4dd-c642-4699-aa05-3db68c73a9d7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1750 microversion: 2.20 time: 1.744867 Apr 21 14:43:07.500832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 292/552] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:05 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1750 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:08.011839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fee70267-8682-4137-b817-97277270d1e6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:08.068023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fee70267-8682-4137-b817-97277270d1e6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 1.518149 Apr 21 14:43:08.073334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 261/553] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:06 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:08.530948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:08.532932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:08.557864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:08.558645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:08.560086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:08.560751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:08.897605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:08.909565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:08.911390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:08.912681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bacad011-6b12-41ee-9627-b1046b06e937 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1752 microversion: 2.20 time: 0.387329 Apr 21 14:43:08.913291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 293/554] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:08 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1752 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:43:09.088912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ad3e4b8a-e43c-4e58-8006-fffe6f697d77 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:09.089595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ad3e4b8a-e43c-4e58-8006-fffe6f697d77 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:09.101788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad3e4b8a-e43c-4e58-8006-fffe6f697d77 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:09.102978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad3e4b8a-e43c-4e58-8006-fffe6f697d77 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:09.104774 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad3e4b8a-e43c-4e58-8006-fffe6f697d77 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:09.105825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad3e4b8a-e43c-4e58-8006-fffe6f697d77 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:09.780557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e655898e-7f7e-4305-83c9-998b7e39c574 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Action: 'create', calling method: .version_select at 0x7f19df1296a8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1645923430"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:10.196555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad3e4b8a-e43c-4e58-8006-fffe6f697d77 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:10.217900 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ad3e4b8a-e43c-4e58-8006-fffe6f697d77 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 1.132680 Apr 21 14:43:10.220627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 262/555] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:09 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:10.243810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:10.245550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:10.266542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:10.267396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:10.269241 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:10.270173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:10.858419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e655898e-7f7e-4305-83c9-998b7e39c574 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.255414 Apr 21 14:43:10.874330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 294/556] 10.222.0.24 () {60 vars in 1145 bytes} [Wed Apr 21 14:43:09 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1272 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 21 14:43:10.884755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f1326e62-db70-40a9-bf77-a2f409eb2397 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dee6d048>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:11.175557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f1326e62-db70-40a9-bf77-a2f409eb2397 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4" status: 200 len: 345 microversion: 2.1 time: 0.298422 Apr 21 14:43:11.176803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 295/557] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:43:10 2021] GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4 => generated 345 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:11.195327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-21c0e34b-f389-4d0f-bb41-1d30fb370101 req-f246f4eb-d52d-4204-9b38-931e7283503b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ad6998-eddd-4b1f-b1f8-adada36a72a7", "name": "network-vif-plugged", "status": "completed", "tag": "cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:11.197695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:43:11.197695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:43:11.203010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:11.218954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:11.219359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-21c0e34b-f389-4d0f-bb41-1d30fb370101 req-f246f4eb-d52d-4204-9b38-931e7283503b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:11.219885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-21c0e34b-f389-4d0f-bb41-1d30fb370101 req-f246f4eb-d52d-4204-9b38-931e7283503b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:11.221676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:11.223371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a0ce3f82-bf7f-4dde-a964-6175533a9f08 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1752 microversion: 2.20 time: 0.999714 Apr 21 14:43:11.225031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 263/558] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:10 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1752 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:11.245802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a5ddf14-41b6-4afb-b146-43066eb48fca tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:11.246451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a5ddf14-41b6-4afb-b146-43066eb48fca tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:11.250378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-21c0e34b-f389-4d0f-bb41-1d30fb370101 req-f246f4eb-d52d-4204-9b38-931e7283503b service nova] Creating event network-vif-plugged:cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7 for instance 96ad6998-eddd-4b1f-b1f8-adada36a72a7 on hv-cinder-78638 Apr 21 14:43:11.257863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-21c0e34b-f389-4d0f-bb41-1d30fb370101 req-f246f4eb-d52d-4204-9b38-931e7283503b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069351 Apr 21 14:43:11.259971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 296/559] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:43:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:11.261708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a5ddf14-41b6-4afb-b146-43066eb48fca tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:11.262501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a5ddf14-41b6-4afb-b146-43066eb48fca tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:11.263771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a5ddf14-41b6-4afb-b146-43066eb48fca tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:11.264453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a5ddf14-41b6-4afb-b146-43066eb48fca tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:12.059477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3a5ddf14-41b6-4afb-b146-43066eb48fca tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:12.076519 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a5ddf14-41b6-4afb-b146-43066eb48fca tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1260 microversion: 2.1 time: 0.834572 Apr 21 14:43:12.077641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 264/560] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:11 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1260 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:12.195853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-be421c4b-a3a4-4fcd-814b-086a47059eb5 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19df12e730>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:12.262940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:12.264225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:12.320890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-be421c4b-a3a4-4fcd-814b-086a47059eb5 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4" status: 200 len: 346 microversion: 2.1 time: 0.129915 Apr 21 14:43:12.322219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 297/561] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:43:12 2021] GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4 => generated 346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:12.322694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:12.323633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:12.325266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:12.330141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:12.345489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dc615afe-0b80-4286-858c-9338938f75d7 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Action: 'create', calling method: .version_select at 0x7f19e3cdc268>, body: {"snapshot": {"volume_id": "4e017d75-a9e8-47c9-96f8-5710c744f2b4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1005351589"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:12.980279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dc615afe-0b80-4286-858c-9338938f75d7 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.649064 Apr 21 14:43:12.981555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 298/562] 10.222.0.24 () {60 vars in 1152 bytes} [Wed Apr 21 14:43:12 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:43:12.997169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-52af6b35-067d-46ba-bccf-3220388d0ad2 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dee6db70>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:13.118954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:13.179877 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:13.186615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:13.204901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-81f2e523-e713-465b-beca-268107f4ee26 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.963673 Apr 21 14:43:13.206966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 265/563] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:12 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:13.247606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0d4ec01d-9855-46aa-95af-6e919d5a009a tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:13.251177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0d4ec01d-9855-46aa-95af-6e919d5a009a tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:13.297742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0d4ec01d-9855-46aa-95af-6e919d5a009a tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:13.299886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0d4ec01d-9855-46aa-95af-6e919d5a009a tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:13.303141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0d4ec01d-9855-46aa-95af-6e919d5a009a tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:13.304572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0d4ec01d-9855-46aa-95af-6e919d5a009a tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:13.304745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-52af6b35-067d-46ba-bccf-3220388d0ad2 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 200 len: 287 microversion: 2.1 time: 0.311681 Apr 21 14:43:13.305579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 299/564] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:43:12 2021] GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 287 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:13.317791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-63d3ce24-3393-4dc1-8a71-0e3b53539fd1 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19e3cdc1e0>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:13.457064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-63d3ce24-3393-4dc1-8a71-0e3b53539fd1 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.144223 Apr 21 14:43:13.459225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 300/565] 10.222.0.24 () {58 vars in 1130 bytes} [Wed Apr 21 14:43:13 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:13.469203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bd5c17da-777a-4397-9466-dc80fac4b1b5 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19df129b70>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:13.604862 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bd5c17da-777a-4397-9466-dc80fac4b1b5 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 200 len: 287 microversion: 2.1 time: 0.139955 Apr 21 14:43:13.606065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 301/566] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:43:13 2021] GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:13.877368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0d4ec01d-9855-46aa-95af-6e919d5a009a tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:13.891712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0d4ec01d-9855-46aa-95af-6e919d5a009a tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1443 microversion: 2.1 time: 0.667355 Apr 21 14:43:13.892702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 266/567] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:13 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1443 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:13.917676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e95641d1-60d5-4aa1-afe7-9fc61aa2f84c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:13.918840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e95641d1-60d5-4aa1-afe7-9fc61aa2f84c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:13.929583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e95641d1-60d5-4aa1-afe7-9fc61aa2f84c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:13.930483 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e95641d1-60d5-4aa1-afe7-9fc61aa2f84c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:13.931621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e95641d1-60d5-4aa1-afe7-9fc61aa2f84c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:13.932360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e95641d1-60d5-4aa1-afe7-9fc61aa2f84c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:14.242795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:14.243469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:14.259396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:14.268463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:14.271618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:14.274838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:14.436948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e95641d1-60d5-4aa1-afe7-9fc61aa2f84c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:14.459074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e95641d1-60d5-4aa1-afe7-9fc61aa2f84c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1443 microversion: 2.1 time: 0.535578 Apr 21 14:43:14.459837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 302/568] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:13 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1443 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:14.631237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1e22da4c-2c65-48d8-aaca-f9c27cbdfbbb tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19e071a048>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:14.704547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:14.723822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1e22da4c-2c65-48d8-aaca-f9c27cbdfbbb tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 200 len: 287 microversion: 2.1 time: 0.110432 Apr 21 14:43:14.725100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 303/569] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:43:14 2021] GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:14.733928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:14.739984 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:14.742600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0e4cc34f-3213-42d2-8620-1739662f49c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.503965 Apr 21 14:43:14.746449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 267/570] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:14 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:15.754639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a00d87a0-30c8-4c27-a0f3-bf3d0a1bd509 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dee6d730>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:15.781137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:15.782320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:15.808411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:15.809212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:15.811842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:15.812632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:15.874674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a00d87a0-30c8-4c27-a0f3-bf3d0a1bd509 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 200 len: 287 microversion: 2.1 time: 0.140170 Apr 21 14:43:15.880400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 304/571] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:43:15 2021] GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:16.380786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:16.393220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:16.395695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:16.397216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-35890cfe-b463-4ff9-ba55-07c8d6c0480f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.621170 Apr 21 14:43:16.398071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 268/572] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:15 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:16.906657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-820583b5-b695-405f-9563-9b3fa76ac0f9 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dee6d598>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:17.208745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-820583b5-b695-405f-9563-9b3fa76ac0f9 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 200 len: 287 microversion: 2.1 time: 0.322427 Apr 21 14:43:17.212491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 305/573] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:43:16 2021] GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 287 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:17.417264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:17.418029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:17.438063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:17.438500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:17.439396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:17.439892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:18.198215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:18.259180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f922ea6-1752-4f59-ba3c-4258a0d2bdd5 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dee6d510>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:18.274252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:18.286680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:18.298173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-de8d379d-d41c-48df-99b2-519bece8aad2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.876997 Apr 21 14:43:18.302396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 269/574] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:17 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:43:18.370044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f922ea6-1752-4f59-ba3c-4258a0d2bdd5 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 200 len: 287 microversion: 2.1 time: 0.130238 Apr 21 14:43:18.370682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 306/575] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:43:18 2021] GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:19.319998 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:19.321396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:19.332368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:19.333068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:19.338925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:19.339640 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:19.383264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5313eaf9-fbf0-45ed-98b8-d845c342a742 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19e3cdc268>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:19.528968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5313eaf9-fbf0-45ed-98b8-d845c342a742 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 200 len: 288 microversion: 2.1 time: 0.150210 Apr 21 14:43:19.529725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 307/576] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:43:19 2021] GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 288 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:19.541336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-06ab033f-cc3b-4717-b3cc-4825a43af377 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dee6d8c8>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:19.897044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-06ab033f-cc3b-4717-b3cc-4825a43af377 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 202 len: 0 microversion: 2.1 time: 0.360262 Apr 21 14:43:19.898500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 308/577] 10.222.0.24 () {58 vars in 1244 bytes} [Wed Apr 21 14:43:19 2021] DELETE /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:43:19.905144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a6466ff1-34a5-4f87-8b2d-14f3f209ef3e req-44d3c84b-e299-4746-8e52-963c41305697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ad6998-eddd-4b1f-b1f8-adada36a72a7", "tag": "cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:19.912183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:43:19.912183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:43:19.936458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a6466ff1-34a5-4f87-8b2d-14f3f209ef3e req-44d3c84b-e299-4746-8e52-963c41305697 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:19.939822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a6466ff1-34a5-4f87-8b2d-14f3f209ef3e req-44d3c84b-e299-4746-8e52-963c41305697 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:19.994830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a6466ff1-34a5-4f87-8b2d-14f3f209ef3e req-44d3c84b-e299-4746-8e52-963c41305697 service nova] Creating event network-changed:cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7 for instance 96ad6998-eddd-4b1f-b1f8-adada36a72a7 on hv-cinder-78638 Apr 21 14:43:20.015524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a6466ff1-34a5-4f87-8b2d-14f3f209ef3e req-44d3c84b-e299-4746-8e52-963c41305697 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115142 Apr 21 14:43:20.016208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 309/578] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:43:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:20.023330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:20.045601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:20.047658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:20.047818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a86f76ab-f058-4494-9c21-09b9596603c2 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dee6dbf8>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:20.051645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8f0322f7-0e1f-4af5-84e1-86b55c79f8ad tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.735841 Apr 21 14:43:20.055042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 270/579] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:19 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:20.167036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a86f76ab-f058-4494-9c21-09b9596603c2 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 200 len: 287 microversion: 2.1 time: 0.148744 Apr 21 14:43:20.167982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 310/580] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:43:20 2021] GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:21.076239 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:21.077018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:21.096173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1380669451", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "networks": [{"uuid": "9327aacc-fa36-490f-aded-1b1eb5e76615"}]}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:21.097482 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:21.098029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:21.098918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:21.099416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:21.375987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] validate_networks() for [('9327aacc-fa36-490f-aded-1b1eb5e76615', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:43:22.183851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:22.204531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:22.212382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:22.213748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9aa228e8-7f16-4123-9b31-1717f957c48e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 1.144377 Apr 21 14:43:22.226938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 271/581] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:21 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:22.239724 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-25211847-5782-4e09-bbe1-8019e5e49bf7 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19de81f510>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:22.324021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-25211847-5782-4e09-bbe1-8019e5e49bf7 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] HTTP exception thrown: Snapshot 744cc3be-a50a-47c9-bff3-debe13aa7614 could not be found. Apr 21 14:43:22.324692 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-25211847-5782-4e09-bbe1-8019e5e49bf7 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Returning 404 to user: Snapshot 744cc3be-a50a-47c9-bff3-debe13aa7614 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:43:22.325598 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-25211847-5782-4e09-bbe1-8019e5e49bf7 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614" status: 404 len: 111 microversion: 2.1 time: 0.097385 Apr 21 14:43:22.326254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 272/582] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:43:22 2021] GET /compute/v2.1/os-snapshots/744cc3be-a50a-47c9-bff3-debe13aa7614 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:43:22.335553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e51fa142-99f7-4e93-b8fb-9d58717f28a5 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19de7f4f28>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:22.504439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e51fa142-99f7-4e93-b8fb-9d58717f28a5 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4" status: 202 len: 0 microversion: 2.1 time: 0.173009 Apr 21 14:43:22.505329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 273/583] 10.222.0.24 () {58 vars in 1238 bytes} [Wed Apr 21 14:43:22 2021] DELETE /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:43:22.516601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-97036e82-2264-4c13-a7c8-cc747486be38 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dfd040d0>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:22.730184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-97036e82-2264-4c13-a7c8-cc747486be38 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4" status: 200 len: 345 microversion: 2.1 time: 0.217674 Apr 21 14:43:22.731736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 274/584] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:43:22 2021] GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4 => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:23.247908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:23.249200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:23.311242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:23.312322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:23.313977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:23.314956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:23.555759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:43:23.556747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:43:23.557845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:43:23.558656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:43:23.559245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:43:23.583109 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:23.590096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:23.593626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:23.597301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:23.699645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Getting quotas for project f8c0e6515053422b8185d7532e81af1c. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:43:23.721766 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Getting quotas for user 2dc678f433f0494abf27ca6f1ccb53ea and project f8c0e6515053422b8185d7532e81af1c. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:43:23.785951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:43:23.792255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:43:23.956732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aff56adc-da80-40bb-a392-dc1958cdd114 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.864398 Apr 21 14:43:23.958583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 311/585] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:43:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 2867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:43:23.966379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8fb67e95-3178-4922-924f-b95f22dc10ba tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19df129268>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:24.275252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-8fb67e95-3178-4922-924f-b95f22dc10ba tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] HTTP exception thrown: Volume 4e017d75-a9e8-47c9-96f8-5710c744f2b4 could not be found. Apr 21 14:43:24.282918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8fb67e95-3178-4922-924f-b95f22dc10ba tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Returning 404 to user: Volume 4e017d75-a9e8-47c9-96f8-5710c744f2b4 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:43:24.285278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8fb67e95-3178-4922-924f-b95f22dc10ba tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4" status: 404 len: 109 microversion: 2.1 time: 0.324553 Apr 21 14:43:24.286792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 312/586] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:43:23 2021] GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4 => generated 109 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:43:24.309485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-97b5b912-ac2d-4253-8f37-e2039922bee1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:24.319121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-97b5b912-ac2d-4253-8f37-e2039922bee1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:24.687115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-97b5b912-ac2d-4253-8f37-e2039922bee1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:24.731611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-97b5b912-ac2d-4253-8f37-e2039922bee1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1219 microversion: 2.1 time: 0.442286 Apr 21 14:43:24.745956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 313/587] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:24 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1219 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:24.759512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e1ae7dc9-3aa5-443d-96e6-d231e1ea3dfc tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dee6dea0>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:24.927563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-e1ae7dc9-3aa5-443d-96e6-d231e1ea3dfc tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] HTTP exception thrown: Volume 4e017d75-a9e8-47c9-96f8-5710c744f2b4 could not be found. Apr 21 14:43:24.929008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e1ae7dc9-3aa5-443d-96e6-d231e1ea3dfc tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Returning 404 to user: Volume 4e017d75-a9e8-47c9-96f8-5710c744f2b4 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:43:24.931907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e1ae7dc9-3aa5-443d-96e6-d231e1ea3dfc tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4" status: 404 len: 109 microversion: 2.1 time: 0.194062 Apr 21 14:43:24.933490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 314/588] 10.222.0.24 () {58 vars in 1238 bytes} [Wed Apr 21 14:43:24 2021] DELETE /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4 => generated 109 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:43:24.959931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-da2faa30-a89c-42d0-9496-1c2cff9a6054 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Calling method '.version_select at 0x7f19dee6dae8>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:25.246369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-da2faa30-a89c-42d0-9496-1c2cff9a6054 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] HTTP exception thrown: Volume 4e017d75-a9e8-47c9-96f8-5710c744f2b4 could not be found. Apr 21 14:43:25.247607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-da2faa30-a89c-42d0-9496-1c2cff9a6054 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] Returning 404 to user: Volume 4e017d75-a9e8-47c9-96f8-5710c744f2b4 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:43:25.249276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-da2faa30-a89c-42d0-9496-1c2cff9a6054 tempest-VolumesSnapshotsTestJSON-230897648 tempest-VolumesSnapshotsTestJSON-230897648-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4" status: 404 len: 109 microversion: 2.1 time: 0.309611 Apr 21 14:43:25.251671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 315/589] 10.222.0.24 () {58 vars in 1235 bytes} [Wed Apr 21 14:43:24 2021] GET /compute/v2.1/os-volumes/4e017d75-a9e8-47c9-96f8-5710c744f2b4 => generated 109 bytes in 313 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:43:25.775450 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cb2a8f51-d129-4131-861c-aa0cc99a93ec tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:25.776816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cb2a8f51-d129-4131-861c-aa0cc99a93ec tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:25.825067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb2a8f51-d129-4131-861c-aa0cc99a93ec tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:25.827052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb2a8f51-d129-4131-861c-aa0cc99a93ec tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:25.829299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb2a8f51-d129-4131-861c-aa0cc99a93ec tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:25.830849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb2a8f51-d129-4131-861c-aa0cc99a93ec tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:26.236161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cb2a8f51-d129-4131-861c-aa0cc99a93ec tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:26.266516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cb2a8f51-d129-4131-861c-aa0cc99a93ec tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1215 microversion: 2.1 time: 0.514620 Apr 21 14:43:26.267327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 316/590] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:25 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1215 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:26.796579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:26.845544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:26.856248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:26.864810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7e9735d6-cb04-4d96-ba11-7d65ab468479 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 3.624945 Apr 21 14:43:26.868877 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 275/591] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:23 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 3634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:27.289500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b122be73-b12b-46ee-b969-2ff45c8b432a tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:27.291237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b122be73-b12b-46ee-b969-2ff45c8b432a tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:27.304456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b122be73-b12b-46ee-b969-2ff45c8b432a tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:27.305339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b122be73-b12b-46ee-b969-2ff45c8b432a tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:27.306725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b122be73-b12b-46ee-b969-2ff45c8b432a tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:27.307449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b122be73-b12b-46ee-b969-2ff45c8b432a tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:27.472957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b122be73-b12b-46ee-b969-2ff45c8b432a tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:27.486137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b122be73-b12b-46ee-b969-2ff45c8b432a tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1271 microversion: 2.1 time: 0.200643 Apr 21 14:43:27.487138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 317/592] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:27 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:27.901275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:27.901966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:27.915130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:27.917010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:27.919286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:27.920552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:28.528773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2439f77d-123d-4a18-9831-baa07d70b444 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:28.531708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2439f77d-123d-4a18-9831-baa07d70b444 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:28.553348 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2439f77d-123d-4a18-9831-baa07d70b444 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:28.554213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2439f77d-123d-4a18-9831-baa07d70b444 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:28.556279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2439f77d-123d-4a18-9831-baa07d70b444 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:28.557678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2439f77d-123d-4a18-9831-baa07d70b444 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:28.569829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:28.595067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:28.599341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:28.602939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6afdb7ce-fd07-43b4-8c37-29cf7f905f9f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.705575 Apr 21 14:43:28.604836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 276/593] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:27 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:43:28.782212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2439f77d-123d-4a18-9831-baa07d70b444 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:28.792666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2439f77d-123d-4a18-9831-baa07d70b444 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1271 microversion: 2.1 time: 0.285816 Apr 21 14:43:28.793340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 318/594] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:28 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:29.311988 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c81499de-c377-4ecc-a222-01c47102b6b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'create', calling method: .version_select at 0x7f19de8a37b8>, body: {"keypair": {"name": "tempest-keypair-595400904"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:29.394443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-c81499de-c377-4ecc-a222-01c47102b6b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for project 2023f43db8e84313ace24e0426447810. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:43:29.408312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-c81499de-c377-4ecc-a222-01c47102b6b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for user 9ff00d9db5164c7e9c38bdace0cb94ba and project 2023f43db8e84313ace24e0426447810. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:43:29.624360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:29.625232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:29.636967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:29.637796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:29.638894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:29.639561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:29.748186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-c81499de-c377-4ecc-a222-01c47102b6b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for project 2023f43db8e84313ace24e0426447810. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:43:29.754301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-c81499de-c377-4ecc-a222-01c47102b6b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for user 9ff00d9db5164c7e9c38bdace0cb94ba and project 2023f43db8e84313ace24e0426447810. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:43:29.776891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c81499de-c377-4ecc-a222-01c47102b6b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.924322 Apr 21 14:43:29.777650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 277/595] 10.222.0.24 () {60 vars in 1148 bytes} [Wed Apr 21 14:43:28 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:29.817211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7b7cac70-aaec-4e99-b58c-33113b5609d1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:29.817892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7b7cac70-aaec-4e99-b58c-33113b5609d1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:29.836995 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b7cac70-aaec-4e99-b58c-33113b5609d1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:29.837623 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b7cac70-aaec-4e99-b58c-33113b5609d1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:29.838397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b7cac70-aaec-4e99-b58c-33113b5609d1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:29.845970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b7cac70-aaec-4e99-b58c-33113b5609d1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:30.342476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7b7cac70-aaec-4e99-b58c-33113b5609d1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:30.347758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:30.365425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:30.369691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7b7cac70-aaec-4e99-b58c-33113b5609d1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1271 microversion: 2.1 time: 0.556117 Apr 21 14:43:30.373120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:30.374638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ad4db542-4651-4acf-a67f-00a1c35b83bc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.754569 Apr 21 14:43:30.375201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 278/596] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:29 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1271 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:30.381043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 319/597] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:29 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:31.397436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dba8e6c1-75f7-44cf-991f-07f766624677 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:31.410215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:31.411809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dba8e6c1-75f7-44cf-991f-07f766624677 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:31.415031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:31.457819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dba8e6c1-75f7-44cf-991f-07f766624677 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:31.461420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:31.463917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dba8e6c1-75f7-44cf-991f-07f766624677 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:31.465217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:31.467490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dba8e6c1-75f7-44cf-991f-07f766624677 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:31.469762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:31.471006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dba8e6c1-75f7-44cf-991f-07f766624677 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:31.472265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:32.407184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:32.419331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:32.421254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:32.422819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-56b6538d-ea76-4b2a-b09f-b07380b5676e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 1.021883 Apr 21 14:43:32.424155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 320/598] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:31 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:32.573966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dba8e6c1-75f7-44cf-991f-07f766624677 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:32.585904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dba8e6c1-75f7-44cf-991f-07f766624677 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 1.195931 Apr 21 14:43:32.594561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 279/599] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:31 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:43:33.455650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:33.456435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:33.479129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:33.479648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:33.481639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:33.489301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:33.608780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5b2c94c3-464d-4e19-bee5-d32f9b571a5c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:33.609815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5b2c94c3-464d-4e19-bee5-d32f9b571a5c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:33.621061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b2c94c3-464d-4e19-bee5-d32f9b571a5c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:33.621916 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b2c94c3-464d-4e19-bee5-d32f9b571a5c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:33.623029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b2c94c3-464d-4e19-bee5-d32f9b571a5c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:33.623740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b2c94c3-464d-4e19-bee5-d32f9b571a5c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:34.165193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:34.190990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:34.195998 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:34.197847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0a3c4641-3545-4da7-8d41-735ba51c5474 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.748646 Apr 21 14:43:34.199587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 321/600] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:33 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:34.214586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a0d3a53b-46fc-42f4-ae37-c3241f57a29f req-0a74b688-271a-4658-9cfa-713a9188e310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b687a467-74ce-42cf-b698-e8ea535a3c75", "tag": "cdb83b17-6b0e-4dcc-b58f-0263d304e688"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:34.218746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:43:34.218746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:43:34.234136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a0d3a53b-46fc-42f4-ae37-c3241f57a29f req-0a74b688-271a-4658-9cfa-713a9188e310 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:34.235132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a0d3a53b-46fc-42f4-ae37-c3241f57a29f req-0a74b688-271a-4658-9cfa-713a9188e310 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:34.264182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a0d3a53b-46fc-42f4-ae37-c3241f57a29f req-0a74b688-271a-4658-9cfa-713a9188e310 service nova] Creating event network-changed:cdb83b17-6b0e-4dcc-b58f-0263d304e688 for instance b687a467-74ce-42cf-b698-e8ea535a3c75 on hv-cinder-78638 Apr 21 14:43:34.273204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a0d3a53b-46fc-42f4-ae37-c3241f57a29f req-0a74b688-271a-4658-9cfa-713a9188e310 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070692 Apr 21 14:43:34.275081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 322/601] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:43:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:34.311308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1733287894", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a53d39c-de06-4bc6-9033-7145f2f15e49"}], "security_groups": [{"name": "tempest-securitygroup--1648561511"}], "key_name": "tempest-keypair-595400904", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:34.320929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5b2c94c3-464d-4e19-bee5-d32f9b571a5c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:34.342273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5b2c94c3-464d-4e19-bee5-d32f9b571a5c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 0.738451 Apr 21 14:43:34.343873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 280/602] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:33 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:34.576030 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] validate_networks() for [('6a53d39c-de06-4bc6-9033-7145f2f15e49', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:43:35.237820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:35.239031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:35.257853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:35.258775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:35.260436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:35.261377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:36.024067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:43:36.024834 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:43:36.025341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:43:36.025927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:43:36.026664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:43:36.037929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:36.038847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:36.040070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:36.040832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:36.064363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for project 2023f43db8e84313ace24e0426447810. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:43:36.069968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for user 9ff00d9db5164c7e9c38bdace0cb94ba and project 2023f43db8e84313ace24e0426447810. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:43:36.096898 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:36.099905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:43:36.103079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:43:36.121244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:36.125688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:36.128671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9908a5d0-ada9-4e8f-acc2-159052daf772 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.899622 Apr 21 14:43:36.143779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 281/603] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:35 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:36.154125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-29165b06-90cb-4183-8ced-24869c5ee025 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:36.155198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-29165b06-90cb-4183-8ced-24869c5ee025 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:36.165123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29165b06-90cb-4183-8ced-24869c5ee025 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:36.166077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29165b06-90cb-4183-8ced-24869c5ee025 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:36.167457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29165b06-90cb-4183-8ced-24869c5ee025 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:36.168170 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29165b06-90cb-4183-8ced-24869c5ee025 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:36.190760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9fd7df80-21ef-42f7-b730-ed29e10ce705 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.886617 Apr 21 14:43:36.192339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 323/604] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:43:34 2021] POST /compute/v2.1/servers => generated 402 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 21 14:43:36.211329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fda8a88e-c810-497d-bcb6-4723d226e9a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:36.213092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fda8a88e-c810-497d-bcb6-4723d226e9a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:36.374696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fda8a88e-c810-497d-bcb6-4723d226e9a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:36.387751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fda8a88e-c810-497d-bcb6-4723d226e9a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1237 microversion: 2.1 time: 0.183116 Apr 21 14:43:36.388670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 324/605] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:36 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1237 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:36.586945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-29165b06-90cb-4183-8ced-24869c5ee025 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:36.606041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-29165b06-90cb-4183-8ced-24869c5ee025 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 0.460522 Apr 21 14:43:36.607349 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 282/606] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:36 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:37.160017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:37.160701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:37.169778 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:37.170540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:37.171401 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:37.171891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:37.407740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8b592bb1-6b05-43fd-8149-e80f761b33e3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:37.408451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8b592bb1-6b05-43fd-8149-e80f761b33e3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:37.420088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b592bb1-6b05-43fd-8149-e80f761b33e3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:37.420807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b592bb1-6b05-43fd-8149-e80f761b33e3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:37.421640 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b592bb1-6b05-43fd-8149-e80f761b33e3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:37.422379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b592bb1-6b05-43fd-8149-e80f761b33e3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:37.484429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:37.501672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:37.504502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:37.506169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-79d09e0f-f878-4cd0-8dca-32b5781ef987 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.350425 Apr 21 14:43:37.506795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 325/607] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:37 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:37.633244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-91a201ba-86f9-42cb-97c3-807fa7b57f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:37.634739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-91a201ba-86f9-42cb-97c3-807fa7b57f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:37.644086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91a201ba-86f9-42cb-97c3-807fa7b57f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:37.644950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91a201ba-86f9-42cb-97c3-807fa7b57f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:37.646687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91a201ba-86f9-42cb-97c3-807fa7b57f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:37.647394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91a201ba-86f9-42cb-97c3-807fa7b57f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:37.654231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8b592bb1-6b05-43fd-8149-e80f761b33e3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:37.675520 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8b592bb1-6b05-43fd-8149-e80f761b33e3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1233 microversion: 2.1 time: 0.271415 Apr 21 14:43:37.677029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 283/608] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:37 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1233 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:43:37.902826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-91a201ba-86f9-42cb-97c3-807fa7b57f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:37.916221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-91a201ba-86f9-42cb-97c3-807fa7b57f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 0.291833 Apr 21 14:43:37.916890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 326/609] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:37 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:38.532292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:38.533503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:38.549607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:38.550870 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:38.552455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:38.553416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:38.708793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-68981d9c-976e-47e7-b5c0-edcae8238195 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:38.709541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-68981d9c-976e-47e7-b5c0-edcae8238195 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:38.720924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68981d9c-976e-47e7-b5c0-edcae8238195 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:38.722588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68981d9c-976e-47e7-b5c0-edcae8238195 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:38.724629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68981d9c-976e-47e7-b5c0-edcae8238195 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:38.726364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68981d9c-976e-47e7-b5c0-edcae8238195 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:38.902054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-68981d9c-976e-47e7-b5c0-edcae8238195 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:38.920346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-68981d9c-976e-47e7-b5c0-edcae8238195 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1295 microversion: 2.1 time: 0.212119 Apr 21 14:43:38.934031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 327/610] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:38 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1295 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:38.943196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d8c03064-9ae0-4530-ad54-20312e8b986b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:38.944205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d8c03064-9ae0-4530-ad54-20312e8b986b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:38.962301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8c03064-9ae0-4530-ad54-20312e8b986b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:38.962804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8c03064-9ae0-4530-ad54-20312e8b986b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:38.965812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8c03064-9ae0-4530-ad54-20312e8b986b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:38.970409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8c03064-9ae0-4530-ad54-20312e8b986b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:39.240178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:39.291117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:39.305334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:39.308708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e4738c07-ba6a-4e00-be6f-06d382c71e1e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.784441 Apr 21 14:43:39.310252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 284/611] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:38 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:39.409500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d8c03064-9ae0-4530-ad54-20312e8b986b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:39.426559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d8c03064-9ae0-4530-ad54-20312e8b986b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 0.490169 Apr 21 14:43:39.428052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 328/612] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:38 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:39.951587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9b46678c-2a73-431e-9832-30636ea22591 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:39.952357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9b46678c-2a73-431e-9832-30636ea22591 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:39.970653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b46678c-2a73-431e-9832-30636ea22591 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:39.971695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b46678c-2a73-431e-9832-30636ea22591 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:39.973811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b46678c-2a73-431e-9832-30636ea22591 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:39.977563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b46678c-2a73-431e-9832-30636ea22591 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:40.329387 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:40.330088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:40.339708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:40.340494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:40.341599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:40.342296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:40.712050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:40.724421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:40.726710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:40.728190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-466dab4b-70dd-4b9f-a021-662e769e7af6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.403202 Apr 21 14:43:40.728799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 329/613] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:40 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:40.734473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-66d33769-660b-407a-95e0-fe8fad4284df tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:40.735394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-66d33769-660b-407a-95e0-fe8fad4284df tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:40.744838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66d33769-660b-407a-95e0-fe8fad4284df tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:40.745421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66d33769-660b-407a-95e0-fe8fad4284df tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:40.746612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66d33769-660b-407a-95e0-fe8fad4284df tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:40.747138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66d33769-660b-407a-95e0-fe8fad4284df tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:40.954254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9b46678c-2a73-431e-9832-30636ea22591 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:40.969244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9b46678c-2a73-431e-9832-30636ea22591 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1363 microversion: 2.1 time: 1.019072 Apr 21 14:43:40.971845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 285/614] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:39 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1363 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:41.051986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-66d33769-660b-407a-95e0-fe8fad4284df tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:41.062841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-66d33769-660b-407a-95e0-fe8fad4284df tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 0.332628 Apr 21 14:43:41.063833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 330/615] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:40 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:41.758983 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:41.760183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:41.776293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:41.777176 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:41.778757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:41.779664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:42.000979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3459d74c-155e-4f7d-96bb-f8b5b4b34a9f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:42.005769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3459d74c-155e-4f7d-96bb-f8b5b4b34a9f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:42.041111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3459d74c-155e-4f7d-96bb-f8b5b4b34a9f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:42.043456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3459d74c-155e-4f7d-96bb-f8b5b4b34a9f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:42.045415 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3459d74c-155e-4f7d-96bb-f8b5b4b34a9f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:42.046405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3459d74c-155e-4f7d-96bb-f8b5b4b34a9f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:42.343682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3459d74c-155e-4f7d-96bb-f8b5b4b34a9f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:42.355038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3459d74c-155e-4f7d-96bb-f8b5b4b34a9f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1363 microversion: 2.1 time: 0.369070 Apr 21 14:43:42.355867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 331/616] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:41 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:43:42.361837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b85441c4-a42b-4115-9298-eedee9c1dc30 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:42.365933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b85441c4-a42b-4115-9298-eedee9c1dc30 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:42.388281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b85441c4-a42b-4115-9298-eedee9c1dc30 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:42.389197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b85441c4-a42b-4115-9298-eedee9c1dc30 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:42.390790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b85441c4-a42b-4115-9298-eedee9c1dc30 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:42.391700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b85441c4-a42b-4115-9298-eedee9c1dc30 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:42.413705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:42.430293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:42.433479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:42.435884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f7b5d054-da08-425f-aa60-6302a1b2d715 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.688476 Apr 21 14:43:42.437182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 286/617] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:41 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:42.549095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-64f95d19-04f9-4aff-a0f3-8e728ab67f9d req-0672ddf6-6c63-4a7d-a973-fdb9fb736a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0ca663-e263-49ed-b0c6-874b504da2e3", "tag": "bfdb3723-3356-4b82-8547-cade024b7b10"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:42.553627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:43:42.553627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:43:42.603514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-64f95d19-04f9-4aff-a0f3-8e728ab67f9d req-0672ddf6-6c63-4a7d-a973-fdb9fb736a3f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:42.605007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-64f95d19-04f9-4aff-a0f3-8e728ab67f9d req-0672ddf6-6c63-4a7d-a973-fdb9fb736a3f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:42.660050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-64f95d19-04f9-4aff-a0f3-8e728ab67f9d req-0672ddf6-6c63-4a7d-a973-fdb9fb736a3f service nova] Creating event network-changed:bfdb3723-3356-4b82-8547-cade024b7b10 for instance eb0ca663-e263-49ed-b0c6-874b504da2e3 on hv-cinder-78638 Apr 21 14:43:42.684704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-64f95d19-04f9-4aff-a0f3-8e728ab67f9d req-0672ddf6-6c63-4a7d-a973-fdb9fb736a3f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144131 Apr 21 14:43:42.685707 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 287/618] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:43:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:42.819679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b85441c4-a42b-4115-9298-eedee9c1dc30 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:42.830448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b85441c4-a42b-4115-9298-eedee9c1dc30 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 0.473214 Apr 21 14:43:42.831383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 332/619] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:42 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:43.042881 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-1eaaac32-6776-4d41-bdbf-a5d77fdac33b req-d2eef481-1289-4e17-b3a0-c54a30c10f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf3aa87-b02a-4b58-901a-76f4e825e75a", "name": "network-vif-plugged", "status": "completed", "tag": "245817c6-3c22-47d2-a7ad-82a9d1f0181d"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:43.047444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:43:43.047444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:43:43.065060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-1eaaac32-6776-4d41-bdbf-a5d77fdac33b req-d2eef481-1289-4e17-b3a0-c54a30c10f84 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:43.067006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-1eaaac32-6776-4d41-bdbf-a5d77fdac33b req-d2eef481-1289-4e17-b3a0-c54a30c10f84 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:43.103324 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-1eaaac32-6776-4d41-bdbf-a5d77fdac33b req-d2eef481-1289-4e17-b3a0-c54a30c10f84 service nova] Creating event network-vif-plugged:245817c6-3c22-47d2-a7ad-82a9d1f0181d for instance abf3aa87-b02a-4b58-901a-76f4e825e75a on hv-cinder-78638 Apr 21 14:43:43.115008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-1eaaac32-6776-4d41-bdbf-a5d77fdac33b req-d2eef481-1289-4e17-b3a0-c54a30c10f84 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080322 Apr 21 14:43:43.116681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 288/620] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:43:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:43.377238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-142898d8-6942-4007-8de5-1c45b259e370 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:43.378791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-142898d8-6942-4007-8de5-1c45b259e370 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:43.389670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142898d8-6942-4007-8de5-1c45b259e370 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:43.390912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142898d8-6942-4007-8de5-1c45b259e370 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:43.392005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142898d8-6942-4007-8de5-1c45b259e370 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:43.392715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142898d8-6942-4007-8de5-1c45b259e370 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:43.478868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:43.480124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:43.488967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:43.489839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:43.492255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:43.495125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:43.707818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-142898d8-6942-4007-8de5-1c45b259e370 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:43.718150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-142898d8-6942-4007-8de5-1c45b259e370 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1363 microversion: 2.1 time: 0.345433 Apr 21 14:43:43.719021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 333/621] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:43 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:43.851871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-737e7e42-73d8-4e01-b98d-421805dcba2b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:43.852520 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-737e7e42-73d8-4e01-b98d-421805dcba2b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:43.862011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-737e7e42-73d8-4e01-b98d-421805dcba2b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:43.862643 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-737e7e42-73d8-4e01-b98d-421805dcba2b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:43.863612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-737e7e42-73d8-4e01-b98d-421805dcba2b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:43.864444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-737e7e42-73d8-4e01-b98d-421805dcba2b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:44.048471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:44.067732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:44.070369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:44.071760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e369aa05-4681-4e38-8661-e05ab2776442 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.614375 Apr 21 14:43:44.072394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 289/622] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:43 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:44.179157 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-737e7e42-73d8-4e01-b98d-421805dcba2b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:44.193722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-737e7e42-73d8-4e01-b98d-421805dcba2b tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 0.345814 Apr 21 14:43:44.194577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 334/623] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:43 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:44.737831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-00930486-44e2-42f1-a3e0-7908ce083c75 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:44.738663 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-00930486-44e2-42f1-a3e0-7908ce083c75 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:44.747195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-00930486-44e2-42f1-a3e0-7908ce083c75 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:44.747808 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-00930486-44e2-42f1-a3e0-7908ce083c75 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:44.748753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-00930486-44e2-42f1-a3e0-7908ce083c75 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:44.749339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-00930486-44e2-42f1-a3e0-7908ce083c75 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:45.104881 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:45.106180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:45.116565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:45.117449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:45.118635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:45.119484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:45.256365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-00930486-44e2-42f1-a3e0-7908ce083c75 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:45.287959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-00930486-44e2-42f1-a3e0-7908ce083c75 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1363 microversion: 2.1 time: 0.554234 Apr 21 14:43:45.302555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 290/624] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:44 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1363 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:45.318191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-8d8de8ca-a6bf-4cf0-931b-687dad84e219 req-d55b4cf6-557b-463a-89b7-2bdcf12c8970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b687a467-74ce-42cf-b698-e8ea535a3c75", "name": "network-vif-plugged", "status": "completed", "tag": "cdb83b17-6b0e-4dcc-b58f-0263d304e688"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:45.326662 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:43:45.326662 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:43:45.349757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-8d8de8ca-a6bf-4cf0-931b-687dad84e219 req-d55b4cf6-557b-463a-89b7-2bdcf12c8970 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:45.350963 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-8d8de8ca-a6bf-4cf0-931b-687dad84e219 req-d55b4cf6-557b-463a-89b7-2bdcf12c8970 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:45.427380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-8d8de8ca-a6bf-4cf0-931b-687dad84e219 req-d55b4cf6-557b-463a-89b7-2bdcf12c8970 service nova] Creating event network-vif-plugged:cdb83b17-6b0e-4dcc-b58f-0263d304e688 for instance b687a467-74ce-42cf-b698-e8ea535a3c75 on hv-cinder-78638 Apr 21 14:43:45.449230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-8d8de8ca-a6bf-4cf0-931b-687dad84e219 req-d55b4cf6-557b-463a-89b7-2bdcf12c8970 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140302 Apr 21 14:43:45.453864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 291/625] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:43:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:45.492210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-caaf1409-522b-4b0b-b508-2a50318e39a8 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:45.495506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-caaf1409-522b-4b0b-b508-2a50318e39a8 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:45.532409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-caaf1409-522b-4b0b-b508-2a50318e39a8 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:45.534736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-caaf1409-522b-4b0b-b508-2a50318e39a8 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:45.536489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-caaf1409-522b-4b0b-b508-2a50318e39a8 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:45.537468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-caaf1409-522b-4b0b-b508-2a50318e39a8 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:45.736609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:45.757295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:45.763047 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:45.766319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-78f52fda-9c78-4a52-a0e3-ff8dcd224aa7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1808 microversion: 2.20 time: 0.665846 Apr 21 14:43:45.767911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 335/626] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:45 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1808 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:43:46.028138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-caaf1409-522b-4b0b-b508-2a50318e39a8 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:46.040386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-caaf1409-522b-4b0b-b508-2a50318e39a8 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 0.581814 Apr 21 14:43:46.041059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 292/627] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:45 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:46.337206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d00ccb76-d6a2-4234-9384-8e6ad5ef79e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:46.339516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d00ccb76-d6a2-4234-9384-8e6ad5ef79e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:46.355865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d00ccb76-d6a2-4234-9384-8e6ad5ef79e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:46.356824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d00ccb76-d6a2-4234-9384-8e6ad5ef79e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:46.358447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d00ccb76-d6a2-4234-9384-8e6ad5ef79e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:46.359380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d00ccb76-d6a2-4234-9384-8e6ad5ef79e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:46.636703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d00ccb76-d6a2-4234-9384-8e6ad5ef79e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:46.653793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d00ccb76-d6a2-4234-9384-8e6ad5ef79e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1363 microversion: 2.1 time: 0.325580 Apr 21 14:43:46.655240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 336/628] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:46 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:46.802564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:46.803837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:46.819476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:46.820540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:46.822031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:46.822838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:47.070350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-17bbb01b-b909-47ee-b64a-380928ef7f0e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:47.071013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-17bbb01b-b909-47ee-b64a-380928ef7f0e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:47.080267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17bbb01b-b909-47ee-b64a-380928ef7f0e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:47.080675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17bbb01b-b909-47ee-b64a-380928ef7f0e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:47.081684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17bbb01b-b909-47ee-b64a-380928ef7f0e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:47.082441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17bbb01b-b909-47ee-b64a-380928ef7f0e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:47.169745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:47.187596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:47.191823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:47.194775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dea373e7-9d8e-487f-9608-3addb09374a7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1795 microversion: 2.20 time: 0.400619 Apr 21 14:43:47.196346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 293/629] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:43:46 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1795 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:43:47.360512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-17bbb01b-b909-47ee-b64a-380928ef7f0e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:47.375276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-17bbb01b-b909-47ee-b64a-380928ef7f0e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1319 microversion: 2.1 time: 0.308755 Apr 21 14:43:47.376544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 337/630] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:47 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:47.678941 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e2aa0a5-2b4f-418c-b2a4-cc8e61236d5f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:47.680155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e2aa0a5-2b4f-418c-b2a4-cc8e61236d5f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:47.695933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e2aa0a5-2b4f-418c-b2a4-cc8e61236d5f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:47.697278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e2aa0a5-2b4f-418c-b2a4-cc8e61236d5f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:47.699637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e2aa0a5-2b4f-418c-b2a4-cc8e61236d5f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:47.700394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e2aa0a5-2b4f-418c-b2a4-cc8e61236d5f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:48.083316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8e2aa0a5-2b4f-418c-b2a4-cc8e61236d5f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:48.093433 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e2aa0a5-2b4f-418c-b2a4-cc8e61236d5f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1363 microversion: 2.1 time: 0.423314 Apr 21 14:43:48.094118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 294/631] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:47 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:48.403903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b0fe12bd-0f16-4bfc-80c3-d9a7c6a99785 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:48.404530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b0fe12bd-0f16-4bfc-80c3-d9a7c6a99785 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:48.414340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0fe12bd-0f16-4bfc-80c3-d9a7c6a99785 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:48.414852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0fe12bd-0f16-4bfc-80c3-d9a7c6a99785 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:48.415725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0fe12bd-0f16-4bfc-80c3-d9a7c6a99785 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:48.416223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0fe12bd-0f16-4bfc-80c3-d9a7c6a99785 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:48.652803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0fe12bd-0f16-4bfc-80c3-d9a7c6a99785 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:48.662612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b0fe12bd-0f16-4bfc-80c3-d9a7c6a99785 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1508 microversion: 2.1 time: 0.262729 Apr 21 14:43:48.663112 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 338/632] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:48 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:49.112719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b5b5313b-7c81-4e74-9861-a3c2f854af37 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:49.113386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b5b5313b-7c81-4e74-9861-a3c2f854af37 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:49.121888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b5313b-7c81-4e74-9861-a3c2f854af37 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:49.122693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b5313b-7c81-4e74-9861-a3c2f854af37 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:49.123717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b5313b-7c81-4e74-9861-a3c2f854af37 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:49.124345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b5313b-7c81-4e74-9861-a3c2f854af37 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:49.438760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5b5313b-7c81-4e74-9861-a3c2f854af37 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:49.449856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b5b5313b-7c81-4e74-9861-a3c2f854af37 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1363 microversion: 2.1 time: 0.340882 Apr 21 14:43:49.450770 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 295/633] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:49 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:50.469843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b1d50093-c0f9-4277-850b-98ac08ddca1d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:50.471224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b1d50093-c0f9-4277-850b-98ac08ddca1d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:50.481739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1d50093-c0f9-4277-850b-98ac08ddca1d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:50.482254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1d50093-c0f9-4277-850b-98ac08ddca1d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:50.483320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1d50093-c0f9-4277-850b-98ac08ddca1d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:50.483817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1d50093-c0f9-4277-850b-98ac08ddca1d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:50.746527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b1d50093-c0f9-4277-850b-98ac08ddca1d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:50.756416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b1d50093-c0f9-4277-850b-98ac08ddca1d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1363 microversion: 2.1 time: 0.290754 Apr 21 14:43:50.757201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 339/634] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:50 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:50.900256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-fc4d0087-503b-49dd-858a-e031473e681a req-bf93d8aa-2b70-43e6-9b9c-80f383ab46d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0ca663-e263-49ed-b0c6-874b504da2e3", "name": "network-vif-plugged", "status": "completed", "tag": "bfdb3723-3356-4b82-8547-cade024b7b10"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:50.902737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:43:50.902737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:43:50.913098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-fc4d0087-503b-49dd-858a-e031473e681a req-bf93d8aa-2b70-43e6-9b9c-80f383ab46d0 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:50.913591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-fc4d0087-503b-49dd-858a-e031473e681a req-bf93d8aa-2b70-43e6-9b9c-80f383ab46d0 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:50.933856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-fc4d0087-503b-49dd-858a-e031473e681a req-bf93d8aa-2b70-43e6-9b9c-80f383ab46d0 service nova] Creating event network-vif-plugged:bfdb3723-3356-4b82-8547-cade024b7b10 for instance eb0ca663-e263-49ed-b0c6-874b504da2e3 on hv-cinder-78638 Apr 21 14:43:50.939516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-fc4d0087-503b-49dd-858a-e031473e681a req-bf93d8aa-2b70-43e6-9b9c-80f383ab46d0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043426 Apr 21 14:43:50.940259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 296/635] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:43:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:51.785349 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a6ba7dde-81ca-4afb-87d1-d813ddb4c9cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:51.786325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a6ba7dde-81ca-4afb-87d1-d813ddb4c9cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:51.795128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6ba7dde-81ca-4afb-87d1-d813ddb4c9cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:51.795635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6ba7dde-81ca-4afb-87d1-d813ddb4c9cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:51.796461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6ba7dde-81ca-4afb-87d1-d813ddb4c9cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:51.796973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6ba7dde-81ca-4afb-87d1-d813ddb4c9cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:52.055605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a6ba7dde-81ca-4afb-87d1-d813ddb4c9cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:52.065108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a6ba7dde-81ca-4afb-87d1-d813ddb4c9cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1363 microversion: 2.1 time: 0.283806 Apr 21 14:43:52.065819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 340/636] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:51 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:53.093118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d59d1d1c-1628-4cf8-943d-db58252b4c71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:53.093951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d59d1d1c-1628-4cf8-943d-db58252b4c71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:53.106526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d59d1d1c-1628-4cf8-943d-db58252b4c71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:53.107468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d59d1d1c-1628-4cf8-943d-db58252b4c71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:53.108477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d59d1d1c-1628-4cf8-943d-db58252b4c71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:53.108974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d59d1d1c-1628-4cf8-943d-db58252b4c71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:53.428395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d59d1d1c-1628-4cf8-943d-db58252b4c71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:43:53.438864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d59d1d1c-1628-4cf8-943d-db58252b4c71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1549 microversion: 2.1 time: 0.350328 Apr 21 14:43:53.439438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 297/637] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:43:53 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1549 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:43:53.461113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cede6f18-bdd6-4c99-b19a-ee3080a58dc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:43:53.462074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cede6f18-bdd6-4c99-b19a-ee3080a58dc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:53.475203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cede6f18-bdd6-4c99-b19a-ee3080a58dc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:53.476076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cede6f18-bdd6-4c99-b19a-ee3080a58dc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:53.477485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cede6f18-bdd6-4c99-b19a-ee3080a58dc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:53.478426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cede6f18-bdd6-4c99-b19a-ee3080a58dc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:53.712948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cede6f18-bdd6-4c99-b19a-ee3080a58dc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.259426 Apr 21 14:43:53.713617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 341/638] 10.222.0.24 () {58 vars in 1265 bytes} [Wed Apr 21 14:43:53 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/os-interface => generated 284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:43:56.053599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2695e591-8bc2-4f2b-a993-e68c61c54aab tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:56.054734 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2695e591-8bc2-4f2b-a993-e68c61c54aab tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:56.073927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2695e591-8bc2-4f2b-a993-e68c61c54aab tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:56.075255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2695e591-8bc2-4f2b-a993-e68c61c54aab tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:56.077060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2695e591-8bc2-4f2b-a993-e68c61c54aab tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:56.078038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2695e591-8bc2-4f2b-a993-e68c61c54aab tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:56.078313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-d976b22b-a958-4928-ae59-a0ea84a732a9 req-3aeea276-af71-4972-85af-6a4928535886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0ca663-e263-49ed-b0c6-874b504da2e3", "tag": "bfdb3723-3356-4b82-8547-cade024b7b10"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:56.080411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:43:56.080411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:43:56.099643 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d976b22b-a958-4928-ae59-a0ea84a732a9 req-3aeea276-af71-4972-85af-6a4928535886 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:56.100293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d976b22b-a958-4928-ae59-a0ea84a732a9 req-3aeea276-af71-4972-85af-6a4928535886 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:56.144133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-d976b22b-a958-4928-ae59-a0ea84a732a9 req-3aeea276-af71-4972-85af-6a4928535886 service nova] Creating event network-changed:bfdb3723-3356-4b82-8547-cade024b7b10 for instance eb0ca663-e263-49ed-b0c6-874b504da2e3 on hv-cinder-78638 Apr 21 14:43:56.150319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-d976b22b-a958-4928-ae59-a0ea84a732a9 req-3aeea276-af71-4972-85af-6a4928535886 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076730 Apr 21 14:43:56.154906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 342/639] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:43:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:43:56.301331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2695e591-8bc2-4f2b-a993-e68c61c54aab tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.252085 Apr 21 14:43:56.303944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 298/640] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:43:56 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 21 14:43:57.321974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0b66008b-79f2-4147-a348-65b781fd61c6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:57.326426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0b66008b-79f2-4147-a348-65b781fd61c6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:57.347421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b66008b-79f2-4147-a348-65b781fd61c6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:57.348825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b66008b-79f2-4147-a348-65b781fd61c6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:57.351132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b66008b-79f2-4147-a348-65b781fd61c6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:57.352875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b66008b-79f2-4147-a348-65b781fd61c6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:57.465176 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0b66008b-79f2-4147-a348-65b781fd61c6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.152498 Apr 21 14:43:57.465944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 343/641] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:43:57 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:43:58.483618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0490183a-af4c-4ffc-822e-af3602734490 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:58.486033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0490183a-af4c-4ffc-822e-af3602734490 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:58.506090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0490183a-af4c-4ffc-822e-af3602734490 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:58.507053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0490183a-af4c-4ffc-822e-af3602734490 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:58.508629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0490183a-af4c-4ffc-822e-af3602734490 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:58.509528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0490183a-af4c-4ffc-822e-af3602734490 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:58.667125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0490183a-af4c-4ffc-822e-af3602734490 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.192462 Apr 21 14:43:58.667816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 299/642] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:43:58 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:43:59.680937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-690ddb62-32e8-476f-842c-06b55718442e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:43:59.682248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-690ddb62-32e8-476f-842c-06b55718442e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:43:59.691972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-690ddb62-32e8-476f-842c-06b55718442e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:59.692536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-690ddb62-32e8-476f-842c-06b55718442e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:59.693421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-690ddb62-32e8-476f-842c-06b55718442e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:43:59.693953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-690ddb62-32e8-476f-842c-06b55718442e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:43:59.805484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-690ddb62-32e8-476f-842c-06b55718442e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.128960 Apr 21 14:43:59.806219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 344/643] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:43:59 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:00.822792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a1654974-7d55-4a68-ac19-9aa9ee4e52d7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:00.824001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a1654974-7d55-4a68-ac19-9aa9ee4e52d7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:00.835003 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1654974-7d55-4a68-ac19-9aa9ee4e52d7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:00.835520 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1654974-7d55-4a68-ac19-9aa9ee4e52d7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:00.836452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1654974-7d55-4a68-ac19-9aa9ee4e52d7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:00.836926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1654974-7d55-4a68-ac19-9aa9ee4e52d7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:00.954706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a1654974-7d55-4a68-ac19-9aa9ee4e52d7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.136326 Apr 21 14:44:00.955456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 300/644] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:00 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:01.974656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6c4f32d7-a437-46e5-b834-b7a86e49cca6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:01.974656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6c4f32d7-a437-46e5-b834-b7a86e49cca6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:01.981710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c4f32d7-a437-46e5-b834-b7a86e49cca6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:01.982254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c4f32d7-a437-46e5-b834-b7a86e49cca6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:01.983104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c4f32d7-a437-46e5-b834-b7a86e49cca6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:01.983754 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c4f32d7-a437-46e5-b834-b7a86e49cca6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:02.101590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6c4f32d7-a437-46e5-b834-b7a86e49cca6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.136532 Apr 21 14:44:02.102548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 345/645] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:01 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:03.115102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d8140d27-f43b-425a-9d8d-f70963ae6a08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:03.116272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d8140d27-f43b-425a-9d8d-f70963ae6a08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:03.125853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8140d27-f43b-425a-9d8d-f70963ae6a08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:03.126388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8140d27-f43b-425a-9d8d-f70963ae6a08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:03.127256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8140d27-f43b-425a-9d8d-f70963ae6a08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:03.127798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8140d27-f43b-425a-9d8d-f70963ae6a08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:03.254175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d8140d27-f43b-425a-9d8d-f70963ae6a08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.143039 Apr 21 14:44:03.255141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 301/646] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:03 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:04.267711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bf422d0d-0e87-4a7c-a34c-4cb5227fb674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:04.269291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bf422d0d-0e87-4a7c-a34c-4cb5227fb674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:04.278715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf422d0d-0e87-4a7c-a34c-4cb5227fb674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:04.279192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf422d0d-0e87-4a7c-a34c-4cb5227fb674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:04.280427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf422d0d-0e87-4a7c-a34c-4cb5227fb674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:04.281199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf422d0d-0e87-4a7c-a34c-4cb5227fb674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:04.402265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bf422d0d-0e87-4a7c-a34c-4cb5227fb674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.138777 Apr 21 14:44:04.403108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 346/647] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:04 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:05.415183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-83d5fe70-5817-471a-97b2-977662ea3cdc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:05.416377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-83d5fe70-5817-471a-97b2-977662ea3cdc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:05.426334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83d5fe70-5817-471a-97b2-977662ea3cdc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:05.426859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83d5fe70-5817-471a-97b2-977662ea3cdc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:05.427697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83d5fe70-5817-471a-97b2-977662ea3cdc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:05.428190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83d5fe70-5817-471a-97b2-977662ea3cdc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:05.531070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-83d5fe70-5817-471a-97b2-977662ea3cdc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.120153 Apr 21 14:44:05.531982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 302/648] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:05 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:06.544547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ae98fd7-9e4a-4081-83b9-d5eacb105f08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:06.545699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2ae98fd7-9e4a-4081-83b9-d5eacb105f08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:06.557355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ae98fd7-9e4a-4081-83b9-d5eacb105f08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:06.557835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ae98fd7-9e4a-4081-83b9-d5eacb105f08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:06.558831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ae98fd7-9e4a-4081-83b9-d5eacb105f08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:06.559327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ae98fd7-9e4a-4081-83b9-d5eacb105f08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:06.676717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ae98fd7-9e4a-4081-83b9-d5eacb105f08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.135710 Apr 21 14:44:06.678600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 347/649] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:06 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:07.694894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e04ed4e3-8e16-46ff-b4d3-32b8fabc1d2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:07.696125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e04ed4e3-8e16-46ff-b4d3-32b8fabc1d2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:07.706804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e04ed4e3-8e16-46ff-b4d3-32b8fabc1d2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:07.707326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e04ed4e3-8e16-46ff-b4d3-32b8fabc1d2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:07.708218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e04ed4e3-8e16-46ff-b4d3-32b8fabc1d2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:07.708744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e04ed4e3-8e16-46ff-b4d3-32b8fabc1d2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:07.834706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e04ed4e3-8e16-46ff-b4d3-32b8fabc1d2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.144761 Apr 21 14:44:07.835410 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 303/650] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:07 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:08.848858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed23b842-48ac-4b98-ba96-50bf51e5a428 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:08.850140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ed23b842-48ac-4b98-ba96-50bf51e5a428 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:08.860100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed23b842-48ac-4b98-ba96-50bf51e5a428 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:08.860609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed23b842-48ac-4b98-ba96-50bf51e5a428 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:08.861501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed23b842-48ac-4b98-ba96-50bf51e5a428 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:08.862104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed23b842-48ac-4b98-ba96-50bf51e5a428 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:09.001059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed23b842-48ac-4b98-ba96-50bf51e5a428 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.157187 Apr 21 14:44:09.002377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 348/651] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:08 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:10.017353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3b71e392-3aaf-4f0c-95ef-1de91c0864c7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:10.018994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3b71e392-3aaf-4f0c-95ef-1de91c0864c7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:10.031045 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b71e392-3aaf-4f0c-95ef-1de91c0864c7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:10.031762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b71e392-3aaf-4f0c-95ef-1de91c0864c7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:10.032900 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b71e392-3aaf-4f0c-95ef-1de91c0864c7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:10.033452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b71e392-3aaf-4f0c-95ef-1de91c0864c7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:10.156049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3b71e392-3aaf-4f0c-95ef-1de91c0864c7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 14 microversion: 2.1 time: 0.144690 Apr 21 14:44:10.156961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 304/652] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:10 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:44:11.169016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-844d9abd-a32d-49f4-8a49-e37b6cf85fbc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:11.170273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-844d9abd-a32d-49f4-8a49-e37b6cf85fbc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:11.180267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-844d9abd-a32d-49f4-8a49-e37b6cf85fbc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:11.180869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-844d9abd-a32d-49f4-8a49-e37b6cf85fbc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:11.181821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-844d9abd-a32d-49f4-8a49-e37b6cf85fbc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:11.182401 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-844d9abd-a32d-49f4-8a49-e37b6cf85fbc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:11.308634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-844d9abd-a32d-49f4-8a49-e37b6cf85fbc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 7248 microversion: 2.1 time: 0.143975 Apr 21 14:44:11.309315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 349/653] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:11 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 7248 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:44:12.321958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0875e300-ce2a-4fbf-b259-be52d6ea1198 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:12.323083 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0875e300-ce2a-4fbf-b259-be52d6ea1198 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:12.332655 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0875e300-ce2a-4fbf-b259-be52d6ea1198 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:12.333162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0875e300-ce2a-4fbf-b259-be52d6ea1198 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:12.334050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0875e300-ce2a-4fbf-b259-be52d6ea1198 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:12.334556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0875e300-ce2a-4fbf-b259-be52d6ea1198 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:12.462088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0875e300-ce2a-4fbf-b259-be52d6ea1198 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 12758 microversion: 2.1 time: 0.144685 Apr 21 14:44:12.463083 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 305/654] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:12 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 12758 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:13.476235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-614710cc-1f8f-49da-9717-a59b0e110e0b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:13.477391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-614710cc-1f8f-49da-9717-a59b0e110e0b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:13.486986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-614710cc-1f8f-49da-9717-a59b0e110e0b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:13.487465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-614710cc-1f8f-49da-9717-a59b0e110e0b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:13.488339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-614710cc-1f8f-49da-9717-a59b0e110e0b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:13.488819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-614710cc-1f8f-49da-9717-a59b0e110e0b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:13.619943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-614710cc-1f8f-49da-9717-a59b0e110e0b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 15980 microversion: 2.1 time: 0.148240 Apr 21 14:44:13.620733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 350/655] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:13 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 15980 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:14.634176 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f874fabb-bc86-4d86-a998-532da631e39c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:14.635270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f874fabb-bc86-4d86-a998-532da631e39c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:14.644533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f874fabb-bc86-4d86-a998-532da631e39c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:14.645216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f874fabb-bc86-4d86-a998-532da631e39c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:14.646141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f874fabb-bc86-4d86-a998-532da631e39c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:14.646743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f874fabb-bc86-4d86-a998-532da631e39c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:14.789287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f874fabb-bc86-4d86-a998-532da631e39c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 17861 microversion: 2.1 time: 0.159746 Apr 21 14:44:14.789961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 306/656] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:14 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 17861 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:15.804580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e422064-663f-4835-89e9-ab2cf1696c31 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:15.805930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e422064-663f-4835-89e9-ab2cf1696c31 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:15.815661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e422064-663f-4835-89e9-ab2cf1696c31 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:15.816200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e422064-663f-4835-89e9-ab2cf1696c31 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:15.817061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e422064-663f-4835-89e9-ab2cf1696c31 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:15.817558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e422064-663f-4835-89e9-ab2cf1696c31 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:15.944608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e422064-663f-4835-89e9-ab2cf1696c31 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 18608 microversion: 2.1 time: 0.145978 Apr 21 14:44:15.945322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 351/657] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:15 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 18608 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:16.958444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0a4e3e94-d599-4ee1-a8c6-9582ca67fca0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:16.959612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0a4e3e94-d599-4ee1-a8c6-9582ca67fca0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:16.969801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a4e3e94-d599-4ee1-a8c6-9582ca67fca0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:16.970346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a4e3e94-d599-4ee1-a8c6-9582ca67fca0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:16.971245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a4e3e94-d599-4ee1-a8c6-9582ca67fca0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:16.971746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a4e3e94-d599-4ee1-a8c6-9582ca67fca0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:17.095166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0a4e3e94-d599-4ee1-a8c6-9582ca67fca0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 20173 microversion: 2.1 time: 0.141271 Apr 21 14:44:17.095972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 307/658] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:16 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 20173 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:18.109012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dc45f285-2545-4c1f-b60a-cf0fb537c5a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:18.110201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dc45f285-2545-4c1f-b60a-cf0fb537c5a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:18.119820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc45f285-2545-4c1f-b60a-cf0fb537c5a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:18.120325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc45f285-2545-4c1f-b60a-cf0fb537c5a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:18.121171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc45f285-2545-4c1f-b60a-cf0fb537c5a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:18.121657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc45f285-2545-4c1f-b60a-cf0fb537c5a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:18.250673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dc45f285-2545-4c1f-b60a-cf0fb537c5a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 21929 microversion: 2.1 time: 0.145731 Apr 21 14:44:18.255421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 352/659] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:18 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 21929 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:19.266103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-10862379-cd57-49cb-bfc7-41526f296506 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:19.267293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-10862379-cd57-49cb-bfc7-41526f296506 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:19.276578 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-10862379-cd57-49cb-bfc7-41526f296506 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:19.277090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-10862379-cd57-49cb-bfc7-41526f296506 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:19.277946 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-10862379-cd57-49cb-bfc7-41526f296506 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:19.278470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-10862379-cd57-49cb-bfc7-41526f296506 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:19.566826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-10862379-cd57-49cb-bfc7-41526f296506 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 23218 microversion: 2.1 time: 0.305771 Apr 21 14:44:19.567816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 308/660] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:19 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 23218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:19.805904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-96a84f05-de15-42e9-807f-b6036c607527 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "165e4c82-db33-46a0-aad3-593dbac7ab6e", "device": "/dev/sdb"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:19.808100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-96a84f05-de15-42e9-807f-b6036c607527 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:19.818169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96a84f05-de15-42e9-807f-b6036c607527 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:19.818674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96a84f05-de15-42e9-807f-b6036c607527 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:19.819535 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96a84f05-de15-42e9-807f-b6036c607527 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:19.820027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96a84f05-de15-42e9-807f-b6036c607527 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:20.246944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-96a84f05-de15-42e9-807f-b6036c607527 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "POST /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448797 Apr 21 14:44:20.247750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 353/661] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:44:19 2021] POST /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:44:20.587166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-46ed7b57-7efb-4012-9308-738e6832eab1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:20.589258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-46ed7b57-7efb-4012-9308-738e6832eab1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:20.605592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46ed7b57-7efb-4012-9308-738e6832eab1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:20.606469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46ed7b57-7efb-4012-9308-738e6832eab1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:20.607844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46ed7b57-7efb-4012-9308-738e6832eab1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:20.608397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46ed7b57-7efb-4012-9308-738e6832eab1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:20.755089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-46ed7b57-7efb-4012-9308-738e6832eab1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 23794 microversion: 2.1 time: 0.176165 Apr 21 14:44:20.755701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 309/662] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:20 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 23794 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:21.775191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7d0fe851-6b33-4611-a48c-6ba5c5cf0fa6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:21.777329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7d0fe851-6b33-4611-a48c-6ba5c5cf0fa6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:21.794699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d0fe851-6b33-4611-a48c-6ba5c5cf0fa6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:21.795630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d0fe851-6b33-4611-a48c-6ba5c5cf0fa6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:21.797164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d0fe851-6b33-4611-a48c-6ba5c5cf0fa6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:21.798029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d0fe851-6b33-4611-a48c-6ba5c5cf0fa6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:21.988805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7d0fe851-6b33-4611-a48c-6ba5c5cf0fa6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 24936 microversion: 2.1 time: 0.223181 Apr 21 14:44:21.990438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 354/663] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:21 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 24936 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:23.004736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ddc14ae8-483b-4f0b-b298-0be0640eb4dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:23.005943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ddc14ae8-483b-4f0b-b298-0be0640eb4dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:23.016116 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddc14ae8-483b-4f0b-b298-0be0640eb4dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:23.018556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddc14ae8-483b-4f0b-b298-0be0640eb4dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:23.018918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddc14ae8-483b-4f0b-b298-0be0640eb4dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:23.019524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddc14ae8-483b-4f0b-b298-0be0640eb4dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:23.143288 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ddc14ae8-483b-4f0b-b298-0be0640eb4dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 26118 microversion: 2.1 time: 0.142483 Apr 21 14:44:23.144524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 310/664] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:22 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 26118 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:24.161025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-80ca823a-98a7-46cc-8828-e22e1a78a62c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:24.162332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-80ca823a-98a7-46cc-8828-e22e1a78a62c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:24.171882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80ca823a-98a7-46cc-8828-e22e1a78a62c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:24.172390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80ca823a-98a7-46cc-8828-e22e1a78a62c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:24.173256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80ca823a-98a7-46cc-8828-e22e1a78a62c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:24.173804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80ca823a-98a7-46cc-8828-e22e1a78a62c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:24.316993 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-80ca823a-98a7-46cc-8828-e22e1a78a62c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 27011 microversion: 2.1 time: 0.160348 Apr 21 14:44:24.317659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 355/665] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:24 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 27011 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:25.333159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f86bd654-f78b-4ee5-8944-173927d3dcfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:25.334348 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f86bd654-f78b-4ee5-8944-173927d3dcfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:25.344047 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f86bd654-f78b-4ee5-8944-173927d3dcfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:25.344503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f86bd654-f78b-4ee5-8944-173927d3dcfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:25.345405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f86bd654-f78b-4ee5-8944-173927d3dcfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:25.345901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f86bd654-f78b-4ee5-8944-173927d3dcfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:25.455827 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f86bd654-f78b-4ee5-8944-173927d3dcfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 27614 microversion: 2.1 time: 0.127011 Apr 21 14:44:25.456528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 311/666] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:25 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 27614 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:26.469937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ac843f13-2f8f-4eb7-a377-420317863ac0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:26.471156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ac843f13-2f8f-4eb7-a377-420317863ac0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:26.480528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac843f13-2f8f-4eb7-a377-420317863ac0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:26.481046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac843f13-2f8f-4eb7-a377-420317863ac0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:26.481902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac843f13-2f8f-4eb7-a377-420317863ac0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:26.482426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac843f13-2f8f-4eb7-a377-420317863ac0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:26.626544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ac843f13-2f8f-4eb7-a377-420317863ac0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 27789 microversion: 2.1 time: 0.160493 Apr 21 14:44:26.627587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 356/667] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:26 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 27789 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:27.640749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2f44be1c-d92e-4006-8964-e06d769d2a89 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:27.641975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2f44be1c-d92e-4006-8964-e06d769d2a89 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:27.651964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f44be1c-d92e-4006-8964-e06d769d2a89 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:27.652497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f44be1c-d92e-4006-8964-e06d769d2a89 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:27.653390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f44be1c-d92e-4006-8964-e06d769d2a89 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:27.653890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f44be1c-d92e-4006-8964-e06d769d2a89 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:27.782174 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2f44be1c-d92e-4006-8964-e06d769d2a89 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 27962 microversion: 2.1 time: 0.145864 Apr 21 14:44:27.783093 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 312/668] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:27 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 27962 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:28.798065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dbc41bfa-baf8-437a-9307-def9db911575 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:28.799299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dbc41bfa-baf8-437a-9307-def9db911575 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:28.809562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dbc41bfa-baf8-437a-9307-def9db911575 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:28.810186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dbc41bfa-baf8-437a-9307-def9db911575 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:28.811047 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dbc41bfa-baf8-437a-9307-def9db911575 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:28.811577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dbc41bfa-baf8-437a-9307-def9db911575 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:28.938136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dbc41bfa-baf8-437a-9307-def9db911575 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28163 microversion: 2.1 time: 0.144525 Apr 21 14:44:28.938878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 357/669] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:28 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28163 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:29.952357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f1575e18-86bc-4857-b9fe-d1a7452ce674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:29.953519 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f1575e18-86bc-4857-b9fe-d1a7452ce674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:29.963355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1575e18-86bc-4857-b9fe-d1a7452ce674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:29.963850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1575e18-86bc-4857-b9fe-d1a7452ce674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:29.964718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1575e18-86bc-4857-b9fe-d1a7452ce674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:29.965223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1575e18-86bc-4857-b9fe-d1a7452ce674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:33.475001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f1575e18-86bc-4857-b9fe-d1a7452ce674 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 3.526659 Apr 21 14:44:33.476310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 313/670] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:29 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 3530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:34.490040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5b287879-b028-4b12-ba46-4ab031ffbb0c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:34.491174 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5b287879-b028-4b12-ba46-4ab031ffbb0c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:34.501372 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b287879-b028-4b12-ba46-4ab031ffbb0c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:34.501880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b287879-b028-4b12-ba46-4ab031ffbb0c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:34.502818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b287879-b028-4b12-ba46-4ab031ffbb0c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:34.503316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b287879-b028-4b12-ba46-4ab031ffbb0c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:38.304794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5b287879-b028-4b12-ba46-4ab031ffbb0c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 3.819461 Apr 21 14:44:38.305886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 358/671] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:34 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 3822 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:39.319589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6d988534-2848-4ea5-8587-9c784fc9483c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:39.320956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6d988534-2848-4ea5-8587-9c784fc9483c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:39.334373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d988534-2848-4ea5-8587-9c784fc9483c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:39.335846 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d988534-2848-4ea5-8587-9c784fc9483c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:39.336974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d988534-2848-4ea5-8587-9c784fc9483c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:39.337584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d988534-2848-4ea5-8587-9c784fc9483c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:39.459623 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6d988534-2848-4ea5-8587-9c784fc9483c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.144915 Apr 21 14:44:39.460901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 314/672] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:39 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:40.476225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88050bc1-29d7-401c-a19a-f6008256156e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:40.477715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-88050bc1-29d7-401c-a19a-f6008256156e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:40.487117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88050bc1-29d7-401c-a19a-f6008256156e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:40.487629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88050bc1-29d7-401c-a19a-f6008256156e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:40.488507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88050bc1-29d7-401c-a19a-f6008256156e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:40.489004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88050bc1-29d7-401c-a19a-f6008256156e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:43.501491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88050bc1-29d7-401c-a19a-f6008256156e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 3.030789 Apr 21 14:44:43.505538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 359/673] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:40 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 3036 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:44.517474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2d6d2c35-76bc-4af9-a57e-ce1cce9d8c66 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:44.518928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2d6d2c35-76bc-4af9-a57e-ce1cce9d8c66 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:44.529632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d6d2c35-76bc-4af9-a57e-ce1cce9d8c66 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:44.530165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d6d2c35-76bc-4af9-a57e-ce1cce9d8c66 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:44.531053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d6d2c35-76bc-4af9-a57e-ce1cce9d8c66 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:44.531514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d6d2c35-76bc-4af9-a57e-ce1cce9d8c66 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:44.642255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2d6d2c35-76bc-4af9-a57e-ce1cce9d8c66 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.129323 Apr 21 14:44:44.642957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 315/674] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:44 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:45.656500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-66d14074-237a-4020-b093-173aa94c5c55 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:45.657729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-66d14074-237a-4020-b093-173aa94c5c55 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:45.667486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66d14074-237a-4020-b093-173aa94c5c55 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:45.668004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66d14074-237a-4020-b093-173aa94c5c55 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:45.668833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66d14074-237a-4020-b093-173aa94c5c55 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:45.669344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-66d14074-237a-4020-b093-173aa94c5c55 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:45.794053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-66d14074-237a-4020-b093-173aa94c5c55 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.142084 Apr 21 14:44:45.794815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 360/675] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:45 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:46.814362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-310a43e4-af85-47f6-be4f-c23ce70ddc60 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:46.816658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-310a43e4-af85-47f6-be4f-c23ce70ddc60 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:46.834316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-310a43e4-af85-47f6-be4f-c23ce70ddc60 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:46.835246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-310a43e4-af85-47f6-be4f-c23ce70ddc60 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:46.836851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-310a43e4-af85-47f6-be4f-c23ce70ddc60 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:46.837756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-310a43e4-af85-47f6-be4f-c23ce70ddc60 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:47.045431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-310a43e4-af85-47f6-be4f-c23ce70ddc60 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.240457 Apr 21 14:44:47.046322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 316/676] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:46 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:48.060755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-febfafa0-7133-4290-90aa-873db12bec90 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:48.061936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-febfafa0-7133-4290-90aa-873db12bec90 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:48.072021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-febfafa0-7133-4290-90aa-873db12bec90 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:48.072529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-febfafa0-7133-4290-90aa-873db12bec90 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:48.073438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-febfafa0-7133-4290-90aa-873db12bec90 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:48.073933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-febfafa0-7133-4290-90aa-873db12bec90 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:53.363182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-febfafa0-7133-4290-90aa-873db12bec90 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 5.306254 Apr 21 14:44:53.364815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 361/677] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:48 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 5310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:54.378737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cbffce13-b301-4ffa-8f77-c01e864a3e8a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:54.379830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cbffce13-b301-4ffa-8f77-c01e864a3e8a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:54.389440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cbffce13-b301-4ffa-8f77-c01e864a3e8a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:54.389949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cbffce13-b301-4ffa-8f77-c01e864a3e8a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:54.390850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cbffce13-b301-4ffa-8f77-c01e864a3e8a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:54.391344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cbffce13-b301-4ffa-8f77-c01e864a3e8a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:54.551913 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cbffce13-b301-4ffa-8f77-c01e864a3e8a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.177771 Apr 21 14:44:54.554057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 317/678] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:54 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:55.566583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f422976-954d-49cd-81a7-3a049fe67ec9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:55.567670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f422976-954d-49cd-81a7-3a049fe67ec9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:55.576855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f422976-954d-49cd-81a7-3a049fe67ec9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:55.577365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f422976-954d-49cd-81a7-3a049fe67ec9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:55.578252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f422976-954d-49cd-81a7-3a049fe67ec9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:55.578747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f422976-954d-49cd-81a7-3a049fe67ec9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:55.686337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f422976-954d-49cd-81a7-3a049fe67ec9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.123722 Apr 21 14:44:55.687943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 362/679] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:55 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:56.706464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1a1af4eb-1962-4ea7-8247-064b8489ba6e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:56.708336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1a1af4eb-1962-4ea7-8247-064b8489ba6e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:56.724277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a1af4eb-1962-4ea7-8247-064b8489ba6e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:56.724961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a1af4eb-1962-4ea7-8247-064b8489ba6e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:56.726388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a1af4eb-1962-4ea7-8247-064b8489ba6e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:56.727408 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a1af4eb-1962-4ea7-8247-064b8489ba6e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:56.875197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1a1af4eb-1962-4ea7-8247-064b8489ba6e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.177156 Apr 21 14:44:56.876530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 318/680] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:56 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:57.891794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-327b1053-bef4-4ce0-8cbc-68ceea9930f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:57.893120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-327b1053-bef4-4ce0-8cbc-68ceea9930f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:57.902517 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-327b1053-bef4-4ce0-8cbc-68ceea9930f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:57.903125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-327b1053-bef4-4ce0-8cbc-68ceea9930f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:57.904061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-327b1053-bef4-4ce0-8cbc-68ceea9930f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:57.904601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-327b1053-bef4-4ce0-8cbc-68ceea9930f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:58.208174 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d8687553-d31b-4fed-bc6a-3280c3963614 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:44:58.208810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d8687553-d31b-4fed-bc6a-3280c3963614 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:58.218398 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8687553-d31b-4fed-bc6a-3280c3963614 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:58.219048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8687553-d31b-4fed-bc6a-3280c3963614 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:58.220069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8687553-d31b-4fed-bc6a-3280c3963614 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:58.220658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8687553-d31b-4fed-bc6a-3280c3963614 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:58.251798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-327b1053-bef4-4ce0-8cbc-68ceea9930f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.364148 Apr 21 14:44:58.252567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 363/681] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:57 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:44:58.419957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-d8687553-d31b-4fed-bc6a-3280c3963614 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lazy-loading 'services' on Instance uuid b687a467-74ce-42cf-b698-e8ea535a3c75 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:44:58.571296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d8687553-d31b-4fed-bc6a-3280c3963614 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75/os-volume_attachments/165e4c82-db33-46a0-aad3-593dbac7ab6e" status: 202 len: 0 microversion: 2.1 time: 0.367911 Apr 21 14:44:58.571990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 319/682] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:44:58 2021] DELETE /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75/os-volume_attachments/165e4c82-db33-46a0-aad3-593dbac7ab6e => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:44:59.266631 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-739f57fe-09f1-4837-b7d1-da437e118940 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:44:59.267891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-739f57fe-09f1-4837-b7d1-da437e118940 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:44:59.277854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-739f57fe-09f1-4837-b7d1-da437e118940 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:59.278402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-739f57fe-09f1-4837-b7d1-da437e118940 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:44:59.279273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-739f57fe-09f1-4837-b7d1-da437e118940 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:44:59.279789 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-739f57fe-09f1-4837-b7d1-da437e118940 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:02.113323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-739f57fe-09f1-4837-b7d1-da437e118940 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 2.851406 Apr 21 14:45:02.114611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 364/683] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:44:59 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 2854 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:03.133924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d333fa88-bc21-42c5-b3ba-3008e0820b10 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:03.137241 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d333fa88-bc21-42c5-b3ba-3008e0820b10 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:03.163458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d333fa88-bc21-42c5-b3ba-3008e0820b10 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:03.164856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d333fa88-bc21-42c5-b3ba-3008e0820b10 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:03.167261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d333fa88-bc21-42c5-b3ba-3008e0820b10 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:03.168190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d333fa88-bc21-42c5-b3ba-3008e0820b10 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:03.299768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3e3888af-c6e0-41d0-a54b-168c2ac4d362 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:03.301095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3e3888af-c6e0-41d0-a54b-168c2ac4d362 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:03.317678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e3888af-c6e0-41d0-a54b-168c2ac4d362 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:03.318521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e3888af-c6e0-41d0-a54b-168c2ac4d362 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:03.320188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e3888af-c6e0-41d0-a54b-168c2ac4d362 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:03.321018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e3888af-c6e0-41d0-a54b-168c2ac4d362 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:03.356022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d333fa88-bc21-42c5-b3ba-3008e0820b10 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.230690 Apr 21 14:45:03.357254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 320/684] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:03 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:03.420029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3e3888af-c6e0-41d0-a54b-168c2ac4d362 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:45:03.649207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3e3888af-c6e0-41d0-a54b-168c2ac4d362 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 204 len: 0 microversion: 2.1 time: 0.357646 Apr 21 14:45:03.650009 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 365/685] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:45:03 2021] DELETE /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:45:03.663203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4584168f-350e-4196-ac7a-598185ca2a08 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:03.664050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4584168f-350e-4196-ac7a-598185ca2a08 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:03.674595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4584168f-350e-4196-ac7a-598185ca2a08 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:03.675440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4584168f-350e-4196-ac7a-598185ca2a08 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:03.676303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4584168f-350e-4196-ac7a-598185ca2a08 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:03.676798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4584168f-350e-4196-ac7a-598185ca2a08 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:03.923464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4584168f-350e-4196-ac7a-598185ca2a08 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:03.935114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4584168f-350e-4196-ac7a-598185ca2a08 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1514 microversion: 2.1 time: 0.277600 Apr 21 14:45:03.935853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 321/686] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:03 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:04.371070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8aa2b783-3ff3-45d0-b805-eb7318fcb413 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:04.372339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8aa2b783-3ff3-45d0-b805-eb7318fcb413 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:04.386091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aa2b783-3ff3-45d0-b805-eb7318fcb413 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:04.386604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aa2b783-3ff3-45d0-b805-eb7318fcb413 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:04.387502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aa2b783-3ff3-45d0-b805-eb7318fcb413 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:04.387994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aa2b783-3ff3-45d0-b805-eb7318fcb413 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:04.513104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8aa2b783-3ff3-45d0-b805-eb7318fcb413 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.146697 Apr 21 14:45:04.514220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 366/687] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:04 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:04.955322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9d1691ad-7875-4355-bb87-a05945a87f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:04.956206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9d1691ad-7875-4355-bb87-a05945a87f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:04.965894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d1691ad-7875-4355-bb87-a05945a87f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:04.966414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d1691ad-7875-4355-bb87-a05945a87f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:04.967280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d1691ad-7875-4355-bb87-a05945a87f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:04.967769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d1691ad-7875-4355-bb87-a05945a87f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:05.212632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9d1691ad-7875-4355-bb87-a05945a87f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:05.223128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9d1691ad-7875-4355-bb87-a05945a87f86 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1514 microversion: 2.1 time: 0.271960 Apr 21 14:45:05.223983 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 322/688] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:04 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:05.529275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1f2b29fb-8add-49dc-96cd-417efcfeea61 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:05.530336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1f2b29fb-8add-49dc-96cd-417efcfeea61 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:05.539770 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f2b29fb-8add-49dc-96cd-417efcfeea61 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:05.540277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f2b29fb-8add-49dc-96cd-417efcfeea61 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:05.541130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f2b29fb-8add-49dc-96cd-417efcfeea61 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:05.541624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f2b29fb-8add-49dc-96cd-417efcfeea61 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:05.650529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1f2b29fb-8add-49dc-96cd-417efcfeea61 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.125079 Apr 21 14:45:05.655639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 367/689] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:05 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:06.245760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c717371-e96c-4763-aa1f-608aa288adcf tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:06.246678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5c717371-e96c-4763-aa1f-608aa288adcf tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:06.255709 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c717371-e96c-4763-aa1f-608aa288adcf tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:06.256187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c717371-e96c-4763-aa1f-608aa288adcf tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:06.257208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c717371-e96c-4763-aa1f-608aa288adcf tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:06.257681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c717371-e96c-4763-aa1f-608aa288adcf tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:06.672509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f1a0e1e-00bf-4c3c-9aef-e4fa520506f5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:06.675029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f1a0e1e-00bf-4c3c-9aef-e4fa520506f5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:06.694498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f1a0e1e-00bf-4c3c-9aef-e4fa520506f5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:06.695569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f1a0e1e-00bf-4c3c-9aef-e4fa520506f5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:06.698139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f1a0e1e-00bf-4c3c-9aef-e4fa520506f5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:06.699119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f1a0e1e-00bf-4c3c-9aef-e4fa520506f5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:06.796269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c717371-e96c-4763-aa1f-608aa288adcf tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:06.807332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5c717371-e96c-4763-aa1f-608aa288adcf tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 200 len: 1514 microversion: 2.1 time: 0.568429 Apr 21 14:45:06.808330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 323/690] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:06 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 1514 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:06.890441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f1a0e1e-00bf-4c3c-9aef-e4fa520506f5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.228065 Apr 21 14:45:06.892113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 368/691] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:06 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:45:07.067995 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-2c546a8b-6b06-471f-9ea4-7bcb5cf5cd13 req-08bb1978-0fc6-46e3-a268-65ada650b821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b687a467-74ce-42cf-b698-e8ea535a3c75", "name": "network-vif-deleted", "tag": "cdb83b17-6b0e-4dcc-b58f-0263d304e688"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:07.070377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:45:07.070377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:45:07.082333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2c546a8b-6b06-471f-9ea4-7bcb5cf5cd13 req-08bb1978-0fc6-46e3-a268-65ada650b821 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:07.082835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2c546a8b-6b06-471f-9ea4-7bcb5cf5cd13 req-08bb1978-0fc6-46e3-a268-65ada650b821 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:07.103012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-2c546a8b-6b06-471f-9ea4-7bcb5cf5cd13 req-08bb1978-0fc6-46e3-a268-65ada650b821 service nova] Creating event network-vif-deleted:cdb83b17-6b0e-4dcc-b58f-0263d304e688 for instance b687a467-74ce-42cf-b698-e8ea535a3c75 on hv-cinder-78638 Apr 21 14:45:07.108978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-2c546a8b-6b06-471f-9ea4-7bcb5cf5cd13 req-08bb1978-0fc6-46e3-a268-65ada650b821 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254535 Apr 21 14:45:07.110190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 324/692] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:45:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:45:07.828263 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-85610275-dd56-4d4b-8d19-9374df15ce7d tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:07.829066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-85610275-dd56-4d4b-8d19-9374df15ce7d tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: b687a467-74ce-42cf-b698-e8ea535a3c75] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:07.839248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85610275-dd56-4d4b-8d19-9374df15ce7d tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:07.839760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85610275-dd56-4d4b-8d19-9374df15ce7d tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:07.840663 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85610275-dd56-4d4b-8d19-9374df15ce7d tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:07.841183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85610275-dd56-4d4b-8d19-9374df15ce7d tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:07.902057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-85610275-dd56-4d4b-8d19-9374df15ce7d tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] HTTP exception thrown: Instance b687a467-74ce-42cf-b698-e8ea535a3c75 could not be found. Apr 21 14:45:07.902770 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-85610275-dd56-4d4b-8d19-9374df15ce7d tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Returning 404 to user: Instance b687a467-74ce-42cf-b698-e8ea535a3c75 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:45:07.903717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-85610275-dd56-4d4b-8d19-9374df15ce7d tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75" status: 404 len: 111 microversion: 2.1 time: 0.080713 Apr 21 14:45:07.904371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 369/693] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:07 2021] GET /compute/v2.1/servers/b687a467-74ce-42cf-b698-e8ea535a3c75 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:45:07.910625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e4a9c573-68dc-409f-a876-6a2d3a4cf0bb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:07.912925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e4a9c573-68dc-409f-a876-6a2d3a4cf0bb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:07.926390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4a9c573-68dc-409f-a876-6a2d3a4cf0bb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:07.926940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4a9c573-68dc-409f-a876-6a2d3a4cf0bb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:07.927948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4a9c573-68dc-409f-a876-6a2d3a4cf0bb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:07.928482 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4a9c573-68dc-409f-a876-6a2d3a4cf0bb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:08.060351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e4a9c573-68dc-409f-a876-6a2d3a4cf0bb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.158027 Apr 21 14:45:08.061820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 325/694] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:07 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:09.074838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b55920f-57a1-4fa1-944e-f19ada1d4f82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:09.076343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b55920f-57a1-4fa1-944e-f19ada1d4f82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:09.087524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b55920f-57a1-4fa1-944e-f19ada1d4f82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:09.088272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b55920f-57a1-4fa1-944e-f19ada1d4f82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:09.089426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b55920f-57a1-4fa1-944e-f19ada1d4f82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:09.090152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b55920f-57a1-4fa1-944e-f19ada1d4f82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:12.578209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b55920f-57a1-4fa1-944e-f19ada1d4f82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 3.508224 Apr 21 14:45:12.579014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 370/695] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:09 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 3510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:45:13.592683 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6eab9eb3-0bf8-4919-8c61-7822699bee39 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:13.593952 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6eab9eb3-0bf8-4919-8c61-7822699bee39 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:13.603818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6eab9eb3-0bf8-4919-8c61-7822699bee39 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:13.604325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6eab9eb3-0bf8-4919-8c61-7822699bee39 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:13.605185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6eab9eb3-0bf8-4919-8c61-7822699bee39 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:13.605669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6eab9eb3-0bf8-4919-8c61-7822699bee39 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:13.729683 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6eab9eb3-0bf8-4919-8c61-7822699bee39 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.141668 Apr 21 14:45:13.730944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 326/696] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:13 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:14.746118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5f07e947-6dd2-490c-b348-112a1fe6b702 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:14.747336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5f07e947-6dd2-490c-b348-112a1fe6b702 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:14.756838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f07e947-6dd2-490c-b348-112a1fe6b702 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:14.757333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f07e947-6dd2-490c-b348-112a1fe6b702 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:14.758222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f07e947-6dd2-490c-b348-112a1fe6b702 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:14.758726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f07e947-6dd2-490c-b348-112a1fe6b702 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:14.864673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5f07e947-6dd2-490c-b348-112a1fe6b702 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.123332 Apr 21 14:45:14.866231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 371/697] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:14 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:15.879621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fb545f18-6b70-43b5-ad19-1ceff3aa988b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:15.880812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fb545f18-6b70-43b5-ad19-1ceff3aa988b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:15.890521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb545f18-6b70-43b5-ad19-1ceff3aa988b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:15.891036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb545f18-6b70-43b5-ad19-1ceff3aa988b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:15.891890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb545f18-6b70-43b5-ad19-1ceff3aa988b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:15.892386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb545f18-6b70-43b5-ad19-1ceff3aa988b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:15.996106 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fb545f18-6b70-43b5-ad19-1ceff3aa988b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 0.121053 Apr 21 14:45:15.996857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 327/698] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:15 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:17.010044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-81f17e7f-8bc7-4647-bf69-998f59badab9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:17.011254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-81f17e7f-8bc7-4647-bf69-998f59badab9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:17.021758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f17e7f-8bc7-4647-bf69-998f59badab9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:17.022296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f17e7f-8bc7-4647-bf69-998f59badab9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:17.023384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f17e7f-8bc7-4647-bf69-998f59badab9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:17.023637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f17e7f-8bc7-4647-bf69-998f59badab9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:20.226739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-81f17e7f-8bc7-4647-bf69-998f59badab9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28280 microversion: 2.1 time: 3.220967 Apr 21 14:45:20.227595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 372/699] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:17 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28280 bytes in 3223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:20.272719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:45:20.273050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:45:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:45:20.697492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1433220651", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "networks": [{"uuid": "9327aacc-fa36-490f-aded-1b1eb5e76615"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:20.776057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] validate_networks() for [('9327aacc-fa36-490f-aded-1b1eb5e76615', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:45:21.242797 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-497a64ce-54a8-40fe-8c66-7eb5be88c324 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:21.245208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-497a64ce-54a8-40fe-8c66-7eb5be88c324 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:21.257845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-497a64ce-54a8-40fe-8c66-7eb5be88c324 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:21.259098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-497a64ce-54a8-40fe-8c66-7eb5be88c324 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:21.260474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-497a64ce-54a8-40fe-8c66-7eb5be88c324 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:21.261262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-497a64ce-54a8-40fe-8c66-7eb5be88c324 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:21.375975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-497a64ce-54a8-40fe-8c66-7eb5be88c324 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28571 microversion: 2.1 time: 0.138919 Apr 21 14:45:21.380362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 373/700] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:21 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28571 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:21.556311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:45:21.556790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:45:21.557335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:45:21.557797 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:45:21.558317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:45:21.567850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:21.568366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:21.569236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:21.569735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:21.589158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Getting quotas for project f8c0e6515053422b8185d7532e81af1c. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:45:21.593601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Getting quotas for user 2dc678f433f0494abf27ca6f1ccb53ea and project f8c0e6515053422b8185d7532e81af1c. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:45:21.605466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:45:21.608249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:45:21.664596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-db2781d9-0917-44a7-940c-325196a208ba tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972057 Apr 21 14:45:21.665462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 328/701] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:45:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:45:21.678482 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ccec5679-7de8-4d5a-a9b8-385d59340f35 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:21.679475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ccec5679-7de8-4d5a-a9b8-385d59340f35 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:21.779077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ccec5679-7de8-4d5a-a9b8-385d59340f35 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:21.787762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ccec5679-7de8-4d5a-a9b8-385d59340f35 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1219 microversion: 2.1 time: 0.114343 Apr 21 14:45:21.788485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 374/702] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:21 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:22.390027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7dba974e-8230-4641-a03f-e6878bf5dac7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:22.391339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7dba974e-8230-4641-a03f-e6878bf5dac7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:22.403049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7dba974e-8230-4641-a03f-e6878bf5dac7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:22.403553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7dba974e-8230-4641-a03f-e6878bf5dac7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:22.404407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7dba974e-8230-4641-a03f-e6878bf5dac7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:22.404896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7dba974e-8230-4641-a03f-e6878bf5dac7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:22.511051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7dba974e-8230-4641-a03f-e6878bf5dac7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28571 microversion: 2.1 time: 0.125642 Apr 21 14:45:22.515389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 329/703] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:22 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28571 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:22.819071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4299b6fd-54da-4682-ab39-9b432c993388 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:22.819748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4299b6fd-54da-4682-ab39-9b432c993388 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:22.829654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4299b6fd-54da-4682-ab39-9b432c993388 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:22.830564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4299b6fd-54da-4682-ab39-9b432c993388 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:22.832068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4299b6fd-54da-4682-ab39-9b432c993388 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:22.832802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4299b6fd-54da-4682-ab39-9b432c993388 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:22.970084 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4299b6fd-54da-4682-ab39-9b432c993388 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:22.980000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4299b6fd-54da-4682-ab39-9b432c993388 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1279 microversion: 2.1 time: 0.165118 Apr 21 14:45:22.980860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 375/704] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:22 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1279 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:23.524962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3e904880-0355-42fc-a974-d206e264f972 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:23.526055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3e904880-0355-42fc-a974-d206e264f972 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:23.535855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e904880-0355-42fc-a974-d206e264f972 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:23.536366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e904880-0355-42fc-a974-d206e264f972 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:23.537238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e904880-0355-42fc-a974-d206e264f972 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:23.537737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e904880-0355-42fc-a974-d206e264f972 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:23.641454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3e904880-0355-42fc-a974-d206e264f972 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.120888 Apr 21 14:45:23.642474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 330/705] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:23 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:24.003685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f443acec-f1e0-47e8-872e-107c59df3fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:24.004657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f443acec-f1e0-47e8-872e-107c59df3fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:24.016772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f443acec-f1e0-47e8-872e-107c59df3fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:24.017471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f443acec-f1e0-47e8-872e-107c59df3fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:24.019685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f443acec-f1e0-47e8-872e-107c59df3fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:24.020639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f443acec-f1e0-47e8-872e-107c59df3fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:24.389713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f443acec-f1e0-47e8-872e-107c59df3fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:24.400104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f443acec-f1e0-47e8-872e-107c59df3fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.402487 Apr 21 14:45:24.400932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 376/706] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:23 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:24.660345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ec0729bb-7d0b-4d58-a3ba-7e599adcf6b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:24.662245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ec0729bb-7d0b-4d58-a3ba-7e599adcf6b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:24.678522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec0729bb-7d0b-4d58-a3ba-7e599adcf6b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:24.679419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec0729bb-7d0b-4d58-a3ba-7e599adcf6b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:24.680903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec0729bb-7d0b-4d58-a3ba-7e599adcf6b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:24.681654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec0729bb-7d0b-4d58-a3ba-7e599adcf6b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:24.807240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ec0729bb-7d0b-4d58-a3ba-7e599adcf6b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.155339 Apr 21 14:45:24.808411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 331/707] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:24 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:25.340945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-948b4c0d-b8be-4ff4-a9a1-bfdfdf245082 req-ebac32af-0f8f-43e9-9106-09f3274b824a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2221873-b3ba-4ade-b6ec-61c700a9d453", "tag": "4a662801-d937-4aba-8a74-2b8638623e05"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:25.342886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:45:25.342886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:45:25.353008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-948b4c0d-b8be-4ff4-a9a1-bfdfdf245082 req-ebac32af-0f8f-43e9-9106-09f3274b824a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:25.353521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-948b4c0d-b8be-4ff4-a9a1-bfdfdf245082 req-ebac32af-0f8f-43e9-9106-09f3274b824a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:25.372259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-948b4c0d-b8be-4ff4-a9a1-bfdfdf245082 req-ebac32af-0f8f-43e9-9106-09f3274b824a service nova] Creating event network-changed:4a662801-d937-4aba-8a74-2b8638623e05 for instance f2221873-b3ba-4ade-b6ec-61c700a9d453 on hv-cinder-78638 Apr 21 14:45:25.377721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-948b4c0d-b8be-4ff4-a9a1-bfdfdf245082 req-ebac32af-0f8f-43e9-9106-09f3274b824a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041309 Apr 21 14:45:25.378429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 377/708] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:45:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:45:25.420098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2cbbb0ca-b8dc-4e8d-8222-b2a6e5b4c9f0 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:25.420879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2cbbb0ca-b8dc-4e8d-8222-b2a6e5b4c9f0 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:25.430386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cbbb0ca-b8dc-4e8d-8222-b2a6e5b4c9f0 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:25.430887 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cbbb0ca-b8dc-4e8d-8222-b2a6e5b4c9f0 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:25.431725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cbbb0ca-b8dc-4e8d-8222-b2a6e5b4c9f0 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:25.432203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cbbb0ca-b8dc-4e8d-8222-b2a6e5b4c9f0 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:25.690646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2cbbb0ca-b8dc-4e8d-8222-b2a6e5b4c9f0 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:25.710356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2cbbb0ca-b8dc-4e8d-8222-b2a6e5b4c9f0 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.294237 Apr 21 14:45:25.711988 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 332/709] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:25 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:25.820963 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f551c4dd-9fdc-4888-b526-184339b637ec tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:25.822174 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f551c4dd-9fdc-4888-b526-184339b637ec tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:25.831214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f551c4dd-9fdc-4888-b526-184339b637ec tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:25.831725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f551c4dd-9fdc-4888-b526-184339b637ec tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:25.832587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f551c4dd-9fdc-4888-b526-184339b637ec tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:25.833081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f551c4dd-9fdc-4888-b526-184339b637ec tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:26.732909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f229d887-6346-4b48-87a3-2cfb07159ff5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:26.733562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f229d887-6346-4b48-87a3-2cfb07159ff5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:26.742607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f229d887-6346-4b48-87a3-2cfb07159ff5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:26.743097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f229d887-6346-4b48-87a3-2cfb07159ff5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:26.743941 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f229d887-6346-4b48-87a3-2cfb07159ff5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:26.744430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f229d887-6346-4b48-87a3-2cfb07159ff5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:26.974510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f229d887-6346-4b48-87a3-2cfb07159ff5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:26.983721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f229d887-6346-4b48-87a3-2cfb07159ff5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.254808 Apr 21 14:45:26.984301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 333/710] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:26 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:28.002448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a65b71f0-174a-40e4-b4c4-490a30dfb5dd tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:28.003091 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a65b71f0-174a-40e4-b4c4-490a30dfb5dd tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:28.011405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a65b71f0-174a-40e4-b4c4-490a30dfb5dd tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:28.011936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a65b71f0-174a-40e4-b4c4-490a30dfb5dd tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:28.012720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a65b71f0-174a-40e4-b4c4-490a30dfb5dd tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:28.013231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a65b71f0-174a-40e4-b4c4-490a30dfb5dd tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:28.242992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a65b71f0-174a-40e4-b4c4-490a30dfb5dd tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:28.254625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a65b71f0-174a-40e4-b4c4-490a30dfb5dd tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.256553 Apr 21 14:45:28.257287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 334/711] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:27 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:45:28.846048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f551c4dd-9fdc-4888-b526-184339b637ec tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 3.029445 Apr 21 14:45:28.846859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 378/712] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:25 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 3032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:29.280175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4a6f6990-6a7c-4096-a010-95407ce0600f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:29.280956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4a6f6990-6a7c-4096-a010-95407ce0600f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:29.292099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a6f6990-6a7c-4096-a010-95407ce0600f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:29.292637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a6f6990-6a7c-4096-a010-95407ce0600f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:29.293565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a6f6990-6a7c-4096-a010-95407ce0600f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:29.294110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a6f6990-6a7c-4096-a010-95407ce0600f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:29.784193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4a6f6990-6a7c-4096-a010-95407ce0600f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:29.793792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4a6f6990-6a7c-4096-a010-95407ce0600f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.517662 Apr 21 14:45:29.794527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 335/713] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:29 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:29.861012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-89c3c9dd-150e-44b5-9000-b1460be15096 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:29.862299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-89c3c9dd-150e-44b5-9000-b1460be15096 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:29.871960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89c3c9dd-150e-44b5-9000-b1460be15096 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:29.872466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89c3c9dd-150e-44b5-9000-b1460be15096 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:29.873377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89c3c9dd-150e-44b5-9000-b1460be15096 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:29.873921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89c3c9dd-150e-44b5-9000-b1460be15096 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:29.977768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-89c3c9dd-150e-44b5-9000-b1460be15096 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.121298 Apr 21 14:45:29.979939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 379/714] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:29 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:30.813214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b3dc1227-c488-4b33-a42f-8d5a290f98d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:30.813782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b3dc1227-c488-4b33-a42f-8d5a290f98d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:30.822515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3dc1227-c488-4b33-a42f-8d5a290f98d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:30.823126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3dc1227-c488-4b33-a42f-8d5a290f98d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:30.824037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3dc1227-c488-4b33-a42f-8d5a290f98d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:30.824530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3dc1227-c488-4b33-a42f-8d5a290f98d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:31.006233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f0516403-6ecf-4830-bdd4-64ce4eb53027 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:31.008077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f0516403-6ecf-4830-bdd4-64ce4eb53027 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:31.030884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0516403-6ecf-4830-bdd4-64ce4eb53027 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:31.032701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0516403-6ecf-4830-bdd4-64ce4eb53027 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:31.035123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0516403-6ecf-4830-bdd4-64ce4eb53027 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:31.038071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0516403-6ecf-4830-bdd4-64ce4eb53027 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:31.132597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b3dc1227-c488-4b33-a42f-8d5a290f98d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:31.142980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b3dc1227-c488-4b33-a42f-8d5a290f98d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.333941 Apr 21 14:45:31.143682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 336/715] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:30 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:31.200982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f0516403-6ecf-4830-bdd4-64ce4eb53027 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.210953 Apr 21 14:45:31.201710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 380/716] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:30 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:32.161780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-91201b6f-a0c8-4b7f-a53e-6f47f1a18e3f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:32.162501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-91201b6f-a0c8-4b7f-a53e-6f47f1a18e3f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:32.171443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91201b6f-a0c8-4b7f-a53e-6f47f1a18e3f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:32.172096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91201b6f-a0c8-4b7f-a53e-6f47f1a18e3f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:32.173367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91201b6f-a0c8-4b7f-a53e-6f47f1a18e3f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:32.174047 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91201b6f-a0c8-4b7f-a53e-6f47f1a18e3f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:32.225479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34e2e179-26ef-4dbc-b63d-7a24f547be27 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:32.227740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34e2e179-26ef-4dbc-b63d-7a24f547be27 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:32.244929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34e2e179-26ef-4dbc-b63d-7a24f547be27 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:32.245876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34e2e179-26ef-4dbc-b63d-7a24f547be27 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:32.247493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34e2e179-26ef-4dbc-b63d-7a24f547be27 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:32.248442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34e2e179-26ef-4dbc-b63d-7a24f547be27 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:32.413653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-91201b6f-a0c8-4b7f-a53e-6f47f1a18e3f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:32.427523 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-91201b6f-a0c8-4b7f-a53e-6f47f1a18e3f tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.269874 Apr 21 14:45:32.428422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 337/717] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:32 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:32.430529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34e2e179-26ef-4dbc-b63d-7a24f547be27 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.216837 Apr 21 14:45:32.431776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 381/718] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:32 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:33.444589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-59c40d78-b86f-4522-a412-a343aa9d792f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:33.445694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-59c40d78-b86f-4522-a412-a343aa9d792f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:33.454596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c40d78-b86f-4522-a412-a343aa9d792f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:33.455108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c40d78-b86f-4522-a412-a343aa9d792f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:33.455932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c40d78-b86f-4522-a412-a343aa9d792f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:33.456435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c40d78-b86f-4522-a412-a343aa9d792f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:33.457063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b0f0f974-02f3-48fe-8c8f-5a7d942190ed tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:33.457835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b0f0f974-02f3-48fe-8c8f-5a7d942190ed tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:33.467131 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0f0f974-02f3-48fe-8c8f-5a7d942190ed tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:33.467678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0f0f974-02f3-48fe-8c8f-5a7d942190ed tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:33.468514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0f0f974-02f3-48fe-8c8f-5a7d942190ed tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:33.469078 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0f0f974-02f3-48fe-8c8f-5a7d942190ed tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:33.561914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-59c40d78-b86f-4522-a412-a343aa9d792f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.121121 Apr 21 14:45:33.563540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 338/719] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:33 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:33.708826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0f0f974-02f3-48fe-8c8f-5a7d942190ed tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:33.720472 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b0f0f974-02f3-48fe-8c8f-5a7d942190ed tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.267870 Apr 21 14:45:33.721207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 382/720] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:33 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:34.576328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bc22f811-84aa-44db-8a73-b29c49572f3e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:34.577514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bc22f811-84aa-44db-8a73-b29c49572f3e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:34.586959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc22f811-84aa-44db-8a73-b29c49572f3e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:34.587504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc22f811-84aa-44db-8a73-b29c49572f3e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:34.588365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc22f811-84aa-44db-8a73-b29c49572f3e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:34.588861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc22f811-84aa-44db-8a73-b29c49572f3e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:34.714773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bc22f811-84aa-44db-8a73-b29c49572f3e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.142760 Apr 21 14:45:34.715502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 339/721] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:34 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:34.739672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-859b3c69-e074-42b2-b530-a02a2ff03566 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:34.740354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-859b3c69-e074-42b2-b530-a02a2ff03566 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:34.749147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-859b3c69-e074-42b2-b530-a02a2ff03566 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:34.749657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-859b3c69-e074-42b2-b530-a02a2ff03566 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:34.750604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-859b3c69-e074-42b2-b530-a02a2ff03566 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:34.751095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-859b3c69-e074-42b2-b530-a02a2ff03566 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:34.979905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-859b3c69-e074-42b2-b530-a02a2ff03566 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:34.990926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-859b3c69-e074-42b2-b530-a02a2ff03566 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.254365 Apr 21 14:45:34.990926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 383/722] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:34 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:35.728118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c88da4d-9268-4a5b-9175-688414d9e5b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:35.729343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9c88da4d-9268-4a5b-9175-688414d9e5b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:35.739615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c88da4d-9268-4a5b-9175-688414d9e5b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:35.740140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c88da4d-9268-4a5b-9175-688414d9e5b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:35.740948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c88da4d-9268-4a5b-9175-688414d9e5b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:35.741641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c88da4d-9268-4a5b-9175-688414d9e5b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:35.848645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c88da4d-9268-4a5b-9175-688414d9e5b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.125032 Apr 21 14:45:35.849782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 340/723] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:35 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:36.009211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a04b3f04-f1dc-4fe4-b359-0243076a8fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:36.011235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a04b3f04-f1dc-4fe4-b359-0243076a8fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:36.025967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a04b3f04-f1dc-4fe4-b359-0243076a8fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:36.026502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a04b3f04-f1dc-4fe4-b359-0243076a8fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:36.027456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a04b3f04-f1dc-4fe4-b359-0243076a8fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:36.027810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a04b3f04-f1dc-4fe4-b359-0243076a8fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:36.067729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-19623aae-76b8-4083-9040-0158b4400133 req-4a920635-8f03-4a0d-80b1-cac2676e4c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2221873-b3ba-4ade-b6ec-61c700a9d453", "name": "network-vif-plugged", "status": "completed", "tag": "4a662801-d937-4aba-8a74-2b8638623e05"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:36.069743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:45:36.069743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:45:36.081927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-19623aae-76b8-4083-9040-0158b4400133 req-4a920635-8f03-4a0d-80b1-cac2676e4c6b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:36.082474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-19623aae-76b8-4083-9040-0158b4400133 req-4a920635-8f03-4a0d-80b1-cac2676e4c6b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:36.101265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-19623aae-76b8-4083-9040-0158b4400133 req-4a920635-8f03-4a0d-80b1-cac2676e4c6b service nova] Creating event network-vif-plugged:4a662801-d937-4aba-8a74-2b8638623e05 for instance f2221873-b3ba-4ade-b6ec-61c700a9d453 on hv-cinder-78638 Apr 21 14:45:36.106728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-19623aae-76b8-4083-9040-0158b4400133 req-4a920635-8f03-4a0d-80b1-cac2676e4c6b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192584 Apr 21 14:45:36.107392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 384/724] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:45:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:45:36.271650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a04b3f04-f1dc-4fe4-b359-0243076a8fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:36.283807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a04b3f04-f1dc-4fe4-b359-0243076a8fb1 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.279272 Apr 21 14:45:36.284491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 341/725] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:36 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:45:36.864245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-37fdd6ca-5629-4cc3-8f83-618e007bf990 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:36.865429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-37fdd6ca-5629-4cc3-8f83-618e007bf990 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:36.874518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37fdd6ca-5629-4cc3-8f83-618e007bf990 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:36.875110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37fdd6ca-5629-4cc3-8f83-618e007bf990 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:36.876517 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37fdd6ca-5629-4cc3-8f83-618e007bf990 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:36.877114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37fdd6ca-5629-4cc3-8f83-618e007bf990 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:37.054188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-37fdd6ca-5629-4cc3-8f83-618e007bf990 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.195590 Apr 21 14:45:37.054913 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 385/726] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:36 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:45:37.302798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cee68584-ae7e-498b-a259-1326e9b5d856 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:37.303462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cee68584-ae7e-498b-a259-1326e9b5d856 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:37.312564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cee68584-ae7e-498b-a259-1326e9b5d856 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:37.312910 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cee68584-ae7e-498b-a259-1326e9b5d856 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:37.313785 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cee68584-ae7e-498b-a259-1326e9b5d856 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:37.314315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cee68584-ae7e-498b-a259-1326e9b5d856 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:37.543915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cee68584-ae7e-498b-a259-1326e9b5d856 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:37.553811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cee68584-ae7e-498b-a259-1326e9b5d856 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1319 microversion: 2.1 time: 0.255381 Apr 21 14:45:37.554441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 342/727] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:37 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:38.068199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e30f67d1-846f-4f1b-a482-987ccebd17a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:38.069370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e30f67d1-846f-4f1b-a482-987ccebd17a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:38.078706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e30f67d1-846f-4f1b-a482-987ccebd17a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:38.079341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e30f67d1-846f-4f1b-a482-987ccebd17a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:38.080064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e30f67d1-846f-4f1b-a482-987ccebd17a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:38.080558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e30f67d1-846f-4f1b-a482-987ccebd17a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:38.200899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e30f67d1-846f-4f1b-a482-987ccebd17a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.137314 Apr 21 14:45:38.201680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 386/728] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:38 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:38.572519 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e524fe05-ec8b-42fc-9bcb-b7122a6bc7d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:38.573155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e524fe05-ec8b-42fc-9bcb-b7122a6bc7d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:38.581560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e524fe05-ec8b-42fc-9bcb-b7122a6bc7d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:38.582071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e524fe05-ec8b-42fc-9bcb-b7122a6bc7d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:38.582948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e524fe05-ec8b-42fc-9bcb-b7122a6bc7d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:38.583439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e524fe05-ec8b-42fc-9bcb-b7122a6bc7d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:38.816217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e524fe05-ec8b-42fc-9bcb-b7122a6bc7d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:38.826587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e524fe05-ec8b-42fc-9bcb-b7122a6bc7d5 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1509 microversion: 2.1 time: 0.257988 Apr 21 14:45:38.827198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 343/729] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:38 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:38.845414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-383934a0-3bc0-40f8-a80a-0a4176cb523e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9992e463-665a-4703-a69a-72af36ab612a", "device": "/dev/sdb"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:38.846857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-383934a0-3bc0-40f8-a80a-0a4176cb523e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:38.857363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-383934a0-3bc0-40f8-a80a-0a4176cb523e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:38.857483 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-383934a0-3bc0-40f8-a80a-0a4176cb523e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:38.858323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-383934a0-3bc0-40f8-a80a-0a4176cb523e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:38.858815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-383934a0-3bc0-40f8-a80a-0a4176cb523e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:39.215608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0aa85d31-51f1-44a3-9876-24d2aa20f0b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:39.216729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0aa85d31-51f1-44a3-9876-24d2aa20f0b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:39.225559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0aa85d31-51f1-44a3-9876-24d2aa20f0b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:39.226107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0aa85d31-51f1-44a3-9876-24d2aa20f0b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:39.226958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0aa85d31-51f1-44a3-9876-24d2aa20f0b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:39.227446 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0aa85d31-51f1-44a3-9876-24d2aa20f0b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:39.276432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-383934a0-3bc0-40f8-a80a-0a4176cb523e tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "POST /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435551 Apr 21 14:45:39.277071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 387/730] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:45:38 2021] POST /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:45:39.345706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0aa85d31-51f1-44a3-9876-24d2aa20f0b9 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.134580 Apr 21 14:45:39.347665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 344/731] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:39 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:45:40.360285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8734ea5d-df2e-47ac-9d18-daa5696af262 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:40.361337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8734ea5d-df2e-47ac-9d18-daa5696af262 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:40.371267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8734ea5d-df2e-47ac-9d18-daa5696af262 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:40.371795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8734ea5d-df2e-47ac-9d18-daa5696af262 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:40.372665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8734ea5d-df2e-47ac-9d18-daa5696af262 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:40.373127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8734ea5d-df2e-47ac-9d18-daa5696af262 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:40.483213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8734ea5d-df2e-47ac-9d18-daa5696af262 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.127968 Apr 21 14:45:40.483980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 388/732] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:40 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:41.496469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed2bea83-45cc-4bc7-8f65-38e98761772c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:41.497865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ed2bea83-45cc-4bc7-8f65-38e98761772c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:41.507359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed2bea83-45cc-4bc7-8f65-38e98761772c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:41.507871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed2bea83-45cc-4bc7-8f65-38e98761772c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:41.508724 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed2bea83-45cc-4bc7-8f65-38e98761772c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:41.509221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed2bea83-45cc-4bc7-8f65-38e98761772c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:41.621364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed2bea83-45cc-4bc7-8f65-38e98761772c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.129161 Apr 21 14:45:41.622363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 345/733] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:41 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:42.635112 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e3f2707-3cc3-4a11-95da-4f2665bc2e86 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:42.636303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e3f2707-3cc3-4a11-95da-4f2665bc2e86 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:42.655551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e3f2707-3cc3-4a11-95da-4f2665bc2e86 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:42.655551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e3f2707-3cc3-4a11-95da-4f2665bc2e86 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:42.655551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e3f2707-3cc3-4a11-95da-4f2665bc2e86 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:42.655551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e3f2707-3cc3-4a11-95da-4f2665bc2e86 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:42.770238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e3f2707-3cc3-4a11-95da-4f2665bc2e86 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.139341 Apr 21 14:45:42.771171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 389/734] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:42 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:43.786120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-383d200b-afad-4c46-9c9e-17f9e3afa451 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:43.787339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-383d200b-afad-4c46-9c9e-17f9e3afa451 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:43.797518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-383d200b-afad-4c46-9c9e-17f9e3afa451 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:43.798033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-383d200b-afad-4c46-9c9e-17f9e3afa451 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:43.799128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-383d200b-afad-4c46-9c9e-17f9e3afa451 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:43.799644 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-383d200b-afad-4c46-9c9e-17f9e3afa451 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:43.923994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-383d200b-afad-4c46-9c9e-17f9e3afa451 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.142373 Apr 21 14:45:43.924830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 346/735] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:43 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:44.938122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f70c1d9a-4ce8-40a2-b51d-255b90169595 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:44.939325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f70c1d9a-4ce8-40a2-b51d-255b90169595 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:44.948395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f70c1d9a-4ce8-40a2-b51d-255b90169595 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:44.948910 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f70c1d9a-4ce8-40a2-b51d-255b90169595 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:44.949733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f70c1d9a-4ce8-40a2-b51d-255b90169595 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:44.950278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f70c1d9a-4ce8-40a2-b51d-255b90169595 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:45.072656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f70c1d9a-4ce8-40a2-b51d-255b90169595 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.138869 Apr 21 14:45:45.073379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 390/736] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:44 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:45.232773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ecf78052-3d95-46e9-bbec-994e16c2348c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:45.233547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ecf78052-3d95-46e9-bbec-994e16c2348c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:45.243761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ecf78052-3d95-46e9-bbec-994e16c2348c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:45.244264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ecf78052-3d95-46e9-bbec-994e16c2348c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:45.245151 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ecf78052-3d95-46e9-bbec-994e16c2348c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:45.245633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ecf78052-3d95-46e9-bbec-994e16c2348c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:45.308149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-ecf78052-3d95-46e9-bbec-994e16c2348c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lazy-loading 'flavor' on Instance uuid 96ad6998-eddd-4b1f-b1f8-adada36a72a7 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:45:45.470898 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ecf78052-3d95-46e9-bbec-994e16c2348c tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "POST /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7/action" status: 202 len: 0 microversion: 2.1 time: 0.242904 Apr 21 14:45:45.472047 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 347/737] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:45 2021] POST /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:45:45.481493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2d9875d1-391e-4c0c-be33-a17b03720d0e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:45.482308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2d9875d1-391e-4c0c-be33-a17b03720d0e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:45.491756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d9875d1-391e-4c0c-be33-a17b03720d0e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:45.492160 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d9875d1-391e-4c0c-be33-a17b03720d0e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:45.493043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d9875d1-391e-4c0c-be33-a17b03720d0e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:45.493536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d9875d1-391e-4c0c-be33-a17b03720d0e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:45.729065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2d9875d1-391e-4c0c-be33-a17b03720d0e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:45.738654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2d9875d1-391e-4c0c-be33-a17b03720d0e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.261781 Apr 21 14:45:45.739306 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 391/738] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:45 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:46.086252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2804988b-0ad5-4779-a21c-daa4437c36b4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:46.087452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2804988b-0ad5-4779-a21c-daa4437c36b4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:46.096335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2804988b-0ad5-4779-a21c-daa4437c36b4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:46.096845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2804988b-0ad5-4779-a21c-daa4437c36b4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:46.097715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2804988b-0ad5-4779-a21c-daa4437c36b4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:46.098280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2804988b-0ad5-4779-a21c-daa4437c36b4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:46.214884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2804988b-0ad5-4779-a21c-daa4437c36b4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.133054 Apr 21 14:45:46.215667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 348/739] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:46 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:46.759291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a15b9709-45ea-4f06-8c1e-1e598c5850ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:46.759939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a15b9709-45ea-4f06-8c1e-1e598c5850ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:46.770231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a15b9709-45ea-4f06-8c1e-1e598c5850ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:46.770736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a15b9709-45ea-4f06-8c1e-1e598c5850ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:46.771590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a15b9709-45ea-4f06-8c1e-1e598c5850ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:46.772081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a15b9709-45ea-4f06-8c1e-1e598c5850ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:47.009606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a15b9709-45ea-4f06-8c1e-1e598c5850ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:47.019298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a15b9709-45ea-4f06-8c1e-1e598c5850ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.264645 Apr 21 14:45:47.020224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 392/740] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:46 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:47.229496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-886d12fc-e2c1-4a9e-9f83-c44640a0b805 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:47.230705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-886d12fc-e2c1-4a9e-9f83-c44640a0b805 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:47.240572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-886d12fc-e2c1-4a9e-9f83-c44640a0b805 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:47.241070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-886d12fc-e2c1-4a9e-9f83-c44640a0b805 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:47.241931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-886d12fc-e2c1-4a9e-9f83-c44640a0b805 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:47.242471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-886d12fc-e2c1-4a9e-9f83-c44640a0b805 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:47.361621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-886d12fc-e2c1-4a9e-9f83-c44640a0b805 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.136496 Apr 21 14:45:47.363734 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 349/741] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:47 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:48.037346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb04d39c-e2d2-4818-90bb-1ddea461f53b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:48.038042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb04d39c-e2d2-4818-90bb-1ddea461f53b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:48.046560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb04d39c-e2d2-4818-90bb-1ddea461f53b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:48.047323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb04d39c-e2d2-4818-90bb-1ddea461f53b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:48.048746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb04d39c-e2d2-4818-90bb-1ddea461f53b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:48.049463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb04d39c-e2d2-4818-90bb-1ddea461f53b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:48.280912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eb04d39c-e2d2-4818-90bb-1ddea461f53b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:48.291008 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb04d39c-e2d2-4818-90bb-1ddea461f53b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.257702 Apr 21 14:45:48.291575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 393/742] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:48 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:48.377729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-acb83546-4a99-4154-aa50-029a74d27d72 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:48.378968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-acb83546-4a99-4154-aa50-029a74d27d72 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:48.388372 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-acb83546-4a99-4154-aa50-029a74d27d72 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:48.388891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-acb83546-4a99-4154-aa50-029a74d27d72 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:48.389759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-acb83546-4a99-4154-aa50-029a74d27d72 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:48.390289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-acb83546-4a99-4154-aa50-029a74d27d72 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:49.310096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b8afe4dd-a3a0-4b75-9d47-324324fe556f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:49.310659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b8afe4dd-a3a0-4b75-9d47-324324fe556f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:49.319584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8afe4dd-a3a0-4b75-9d47-324324fe556f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:49.320094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8afe4dd-a3a0-4b75-9d47-324324fe556f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:49.320933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8afe4dd-a3a0-4b75-9d47-324324fe556f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:49.321433 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8afe4dd-a3a0-4b75-9d47-324324fe556f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:49.722429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b8afe4dd-a3a0-4b75-9d47-324324fe556f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:49.732066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b8afe4dd-a3a0-4b75-9d47-324324fe556f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.426122 Apr 21 14:45:49.732793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 394/743] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:49 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:50.755957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-528cf44e-b803-43d6-afa3-a7fa7162e01e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:50.757276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-528cf44e-b803-43d6-afa3-a7fa7162e01e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:50.766791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-528cf44e-b803-43d6-afa3-a7fa7162e01e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:50.767275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-528cf44e-b803-43d6-afa3-a7fa7162e01e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:50.768301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-528cf44e-b803-43d6-afa3-a7fa7162e01e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:50.768797 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-528cf44e-b803-43d6-afa3-a7fa7162e01e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:50.990859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-528cf44e-b803-43d6-afa3-a7fa7162e01e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:51.000571 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-528cf44e-b803-43d6-afa3-a7fa7162e01e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.252894 Apr 21 14:45:51.001436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 395/744] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:50 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:52.019699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e1c4861e-7975-4cb9-a2a9-ec0f50320ba6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:52.020492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e1c4861e-7975-4cb9-a2a9-ec0f50320ba6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:52.030164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1c4861e-7975-4cb9-a2a9-ec0f50320ba6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:52.030964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1c4861e-7975-4cb9-a2a9-ec0f50320ba6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:52.031844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1c4861e-7975-4cb9-a2a9-ec0f50320ba6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:52.032342 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1c4861e-7975-4cb9-a2a9-ec0f50320ba6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:52.270103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1c4861e-7975-4cb9-a2a9-ec0f50320ba6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:52.279746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e1c4861e-7975-4cb9-a2a9-ec0f50320ba6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.264384 Apr 21 14:45:52.280368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 396/745] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:52 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:53.298879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-000069e6-fa89-4368-8548-f16798bc9fda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:53.299512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-000069e6-fa89-4368-8548-f16798bc9fda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:53.309030 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-000069e6-fa89-4368-8548-f16798bc9fda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:53.309540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-000069e6-fa89-4368-8548-f16798bc9fda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:53.310417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-000069e6-fa89-4368-8548-f16798bc9fda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:53.310914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-000069e6-fa89-4368-8548-f16798bc9fda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:53.539645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-000069e6-fa89-4368-8548-f16798bc9fda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:53.553917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-000069e6-fa89-4368-8548-f16798bc9fda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.258872 Apr 21 14:45:53.554721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 397/746] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:53 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:54.576635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e595482f-1f05-4545-b3eb-15684148b0a0 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:54.577209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e595482f-1f05-4545-b3eb-15684148b0a0 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:54.586253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e595482f-1f05-4545-b3eb-15684148b0a0 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:54.586771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e595482f-1f05-4545-b3eb-15684148b0a0 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:54.587619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e595482f-1f05-4545-b3eb-15684148b0a0 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:54.588110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e595482f-1f05-4545-b3eb-15684148b0a0 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:54.628699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-acb83546-4a99-4154-aa50-029a74d27d72 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 6.256148 Apr 21 14:45:54.629538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 350/747] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:48 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 6259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:54.819133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e595482f-1f05-4545-b3eb-15684148b0a0 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:54.828607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e595482f-1f05-4545-b3eb-15684148b0a0 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.256089 Apr 21 14:45:54.829167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 398/748] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:54 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:54.995653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-90a0b353-401f-46e1-ac11-53a0f59a4096 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:54.996290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-90a0b353-401f-46e1-ac11-53a0f59a4096 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:55.005045 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90a0b353-401f-46e1-ac11-53a0f59a4096 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:55.005605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90a0b353-401f-46e1-ac11-53a0f59a4096 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:55.006491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90a0b353-401f-46e1-ac11-53a0f59a4096 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:55.006980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90a0b353-401f-46e1-ac11-53a0f59a4096 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:55.078873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-90a0b353-401f-46e1-ac11-53a0f59a4096 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/os-volume_attachments/75abcebc-7a80-4cc5-abf6-6f4b8aad63be" status: 200 len: 194 microversion: 2.20 time: 0.215997 Apr 21 14:45:55.079429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 351/749] 10.222.0.24 () {60 vars in 1444 bytes} [Wed Apr 21 14:45:54 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/os-volume_attachments/75abcebc-7a80-4cc5-abf6-6f4b8aad63be => generated 194 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:55.198286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-460ced54-48b3-428f-b776-80e5469440ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:55.198820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-460ced54-48b3-428f-b776-80e5469440ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:55.207038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-460ced54-48b3-428f-b776-80e5469440ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:55.207540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-460ced54-48b3-428f-b776-80e5469440ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:55.208397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-460ced54-48b3-428f-b776-80e5469440ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:55.208848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-460ced54-48b3-428f-b776-80e5469440ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:55.387293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-460ced54-48b3-428f-b776-80e5469440ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lazy-loading 'services' on Instance uuid abf3aa87-b02a-4b58-901a-76f4e825e75a {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:45:55.534392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-460ced54-48b3-428f-b776-80e5469440ca tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "DELETE /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/os-volume_attachments/75abcebc-7a80-4cc5-abf6-6f4b8aad63be" status: 202 len: 0 microversion: 2.20 time: 0.339687 Apr 21 14:45:55.535209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 399/750] 10.222.0.24 () {60 vars in 1447 bytes} [Wed Apr 21 14:45:55 2021] DELETE /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a/os-volume_attachments/75abcebc-7a80-4cc5-abf6-6f4b8aad63be => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:45:55.642018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-defe2335-e860-4e2b-9029-4aab19125abc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:55.643107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-defe2335-e860-4e2b-9029-4aab19125abc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:55.652104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-defe2335-e860-4e2b-9029-4aab19125abc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:55.652619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-defe2335-e860-4e2b-9029-4aab19125abc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:55.653477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-defe2335-e860-4e2b-9029-4aab19125abc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:55.653954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-defe2335-e860-4e2b-9029-4aab19125abc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:55.792763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-defe2335-e860-4e2b-9029-4aab19125abc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.154552 Apr 21 14:45:55.793480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 352/751] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:55 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:45:55.847924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a95de464-f51f-4ef0-99b5-d15b46f468b2 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:55.848695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a95de464-f51f-4ef0-99b5-d15b46f468b2 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:55.857379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a95de464-f51f-4ef0-99b5-d15b46f468b2 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:55.857918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a95de464-f51f-4ef0-99b5-d15b46f468b2 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:55.858850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a95de464-f51f-4ef0-99b5-d15b46f468b2 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:55.859342 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a95de464-f51f-4ef0-99b5-d15b46f468b2 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:56.090498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a95de464-f51f-4ef0-99b5-d15b46f468b2 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:56.101629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a95de464-f51f-4ef0-99b5-d15b46f468b2 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.257533 Apr 21 14:45:56.102271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 400/752] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:55 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:45:56.806695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e03de3c9-929b-4c79-814d-0564e6ef82c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:45:56.807865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e03de3c9-929b-4c79-814d-0564e6ef82c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:56.816998 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e03de3c9-929b-4c79-814d-0564e6ef82c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:56.817507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e03de3c9-929b-4c79-814d-0564e6ef82c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:56.818418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e03de3c9-929b-4c79-814d-0564e6ef82c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:56.818916 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e03de3c9-929b-4c79-814d-0564e6ef82c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:57.119793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-13868ac9-2091-4ff2-b4aa-06458278c4d1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:57.120458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-13868ac9-2091-4ff2-b4aa-06458278c4d1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:57.129666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13868ac9-2091-4ff2-b4aa-06458278c4d1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:57.129666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13868ac9-2091-4ff2-b4aa-06458278c4d1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:57.130590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13868ac9-2091-4ff2-b4aa-06458278c4d1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:57.131081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13868ac9-2091-4ff2-b4aa-06458278c4d1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:57.356726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-13868ac9-2091-4ff2-b4aa-06458278c4d1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:57.366855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-13868ac9-2091-4ff2-b4aa-06458278c4d1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.251087 Apr 21 14:45:57.367518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 401/753] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:57 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:58.386558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-838ce1a0-098f-48d0-b353-c518324699b5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:58.387202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-838ce1a0-098f-48d0-b353-c518324699b5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:58.396062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-838ce1a0-098f-48d0-b353-c518324699b5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:58.396567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-838ce1a0-098f-48d0-b353-c518324699b5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:58.397427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-838ce1a0-098f-48d0-b353-c518324699b5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:58.397921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-838ce1a0-098f-48d0-b353-c518324699b5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:58.621175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-838ce1a0-098f-48d0-b353-c518324699b5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:58.631535 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-838ce1a0-098f-48d0-b353-c518324699b5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.249331 Apr 21 14:45:58.632222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 402/754] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:58 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:45:59.650041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7ab26872-2a72-4a8c-8556-07a8371eeffb tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:45:59.650758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7ab26872-2a72-4a8c-8556-07a8371eeffb tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:45:59.659458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ab26872-2a72-4a8c-8556-07a8371eeffb tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:59.659969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ab26872-2a72-4a8c-8556-07a8371eeffb tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:59.660823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ab26872-2a72-4a8c-8556-07a8371eeffb tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:45:59.661318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ab26872-2a72-4a8c-8556-07a8371eeffb tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:45:59.896901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7ab26872-2a72-4a8c-8556-07a8371eeffb tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:45:59.906617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7ab26872-2a72-4a8c-8556-07a8371eeffb tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.260553 Apr 21 14:45:59.907189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 403/755] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:45:59 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:00.842815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e03de3c9-929b-4c79-814d-0564e6ef82c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 4.040383 Apr 21 14:46:00.843605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 353/756] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:45:56 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 4042 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:00.925705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ebae002f-ddf2-4ffe-834c-bc25f9023f8b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:00.926404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ebae002f-ddf2-4ffe-834c-bc25f9023f8b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:00.935185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebae002f-ddf2-4ffe-834c-bc25f9023f8b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:00.935815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebae002f-ddf2-4ffe-834c-bc25f9023f8b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:00.936530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebae002f-ddf2-4ffe-834c-bc25f9023f8b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:00.937018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebae002f-ddf2-4ffe-834c-bc25f9023f8b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:01.156703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ebae002f-ddf2-4ffe-834c-bc25f9023f8b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:01.165965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ebae002f-ddf2-4ffe-834c-bc25f9023f8b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.244787 Apr 21 14:46:01.166662 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 404/757] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:00 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:01.857041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-96afbdd9-2a2c-4967-988d-4e496197046c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:01.858352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-96afbdd9-2a2c-4967-988d-4e496197046c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:01.867514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96afbdd9-2a2c-4967-988d-4e496197046c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:01.868343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96afbdd9-2a2c-4967-988d-4e496197046c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:01.869254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96afbdd9-2a2c-4967-988d-4e496197046c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:01.869752 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96afbdd9-2a2c-4967-988d-4e496197046c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:01.977886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-96afbdd9-2a2c-4967-988d-4e496197046c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.125290 Apr 21 14:46:01.978670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 354/758] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:01 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:02.185852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-99f5d9f3-8f4b-45f0-b96d-401af2a8d860 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:02.186555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-99f5d9f3-8f4b-45f0-b96d-401af2a8d860 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:02.195652 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f3-8f4b-45f0-b96d-401af2a8d860 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:02.196160 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f3-8f4b-45f0-b96d-401af2a8d860 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:02.196970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f3-8f4b-45f0-b96d-401af2a8d860 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:02.197815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-99f5d9f3-8f4b-45f0-b96d-401af2a8d860 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:02.294755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d5e81575-24b8-414d-a92f-007fc1cbbf71 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:02.295403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d5e81575-24b8-414d-a92f-007fc1cbbf71 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:02.304684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5e81575-24b8-414d-a92f-007fc1cbbf71 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:02.305191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5e81575-24b8-414d-a92f-007fc1cbbf71 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:02.306052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5e81575-24b8-414d-a92f-007fc1cbbf71 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:02.306550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5e81575-24b8-414d-a92f-007fc1cbbf71 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:02.373164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d5e81575-24b8-414d-a92f-007fc1cbbf71 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:46:02.423577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-99f5d9f3-8f4b-45f0-b96d-401af2a8d860 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:02.436013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-99f5d9f3-8f4b-45f0-b96d-401af2a8d860 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.255754 Apr 21 14:46:02.436867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 405/759] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:02 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:02.504790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d5e81575-24b8-414d-a92f-007fc1cbbf71 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "DELETE /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 204 len: 0 microversion: 2.20 time: 0.213506 Apr 21 14:46:02.504899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 355/760] 10.222.0.24 () {60 vars in 1270 bytes} [Wed Apr 21 14:46:02 2021] DELETE /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:46:02.513999 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:02.514953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:02.523725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:02.524237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:02.525232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:02.525724 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:02.751783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:02.762145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:02.763846 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:02.765143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ccf289e8-b27c-4dc0-b113-431c3c7781e8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.255633 Apr 21 14:46:02.765748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 406/761] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:02 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:02.991585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f7ac6b9f-71af-4f86-899d-4a1c30bc6e6b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:02.992760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f7ac6b9f-71af-4f86-899d-4a1c30bc6e6b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:03.001209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7ac6b9f-71af-4f86-899d-4a1c30bc6e6b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:03.001704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7ac6b9f-71af-4f86-899d-4a1c30bc6e6b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:03.002682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7ac6b9f-71af-4f86-899d-4a1c30bc6e6b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:03.003111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7ac6b9f-71af-4f86-899d-4a1c30bc6e6b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:03.119448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f7ac6b9f-71af-4f86-899d-4a1c30bc6e6b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.132283 Apr 21 14:46:03.120416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 356/762] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:02 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:03.455309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ec617bd6-2e39-4259-9edc-b85b03f3f5fc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:03.456128 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ec617bd6-2e39-4259-9edc-b85b03f3f5fc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:03.464978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec617bd6-2e39-4259-9edc-b85b03f3f5fc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:03.465488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec617bd6-2e39-4259-9edc-b85b03f3f5fc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:03.466386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec617bd6-2e39-4259-9edc-b85b03f3f5fc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:03.466880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec617bd6-2e39-4259-9edc-b85b03f3f5fc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:03.699375 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ec617bd6-2e39-4259-9edc-b85b03f3f5fc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:03.708961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ec617bd6-2e39-4259-9edc-b85b03f3f5fc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.257872 Apr 21 14:46:03.709626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 407/763] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:03 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:03.787336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:03.788093 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:03.796526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:03.797029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:03.797857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:03.798355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:04.019312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:04.030037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:04.031860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:04.033201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8181f094-1ee8-4222-84e5-4dc5b2fb0def tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.251569 Apr 21 14:46:04.034581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 357/764] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:03 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:46:04.132576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a26b489e-225b-4160-a166-fa2360ab220c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:04.133749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a26b489e-225b-4160-a166-fa2360ab220c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:04.142180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a26b489e-225b-4160-a166-fa2360ab220c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:04.142692 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a26b489e-225b-4160-a166-fa2360ab220c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:04.143661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a26b489e-225b-4160-a166-fa2360ab220c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:04.144151 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a26b489e-225b-4160-a166-fa2360ab220c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:04.248021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a26b489e-225b-4160-a166-fa2360ab220c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.119433 Apr 21 14:46:04.249801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 408/765] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:04 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:04.730999 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-61916ac2-d53a-4e07-9a6c-b3813d4a6b3e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:04.731671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-61916ac2-d53a-4e07-9a6c-b3813d4a6b3e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:04.740206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61916ac2-d53a-4e07-9a6c-b3813d4a6b3e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:04.740721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61916ac2-d53a-4e07-9a6c-b3813d4a6b3e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:04.741575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61916ac2-d53a-4e07-9a6c-b3813d4a6b3e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:04.742080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61916ac2-d53a-4e07-9a6c-b3813d4a6b3e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:04.988000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-61916ac2-d53a-4e07-9a6c-b3813d4a6b3e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:05.006029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-61916ac2-d53a-4e07-9a6c-b3813d4a6b3e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.278701 Apr 21 14:46:05.007211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 358/766] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:04 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:05.054764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:05.055154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:05.064077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:05.064589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:05.065429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:05.065917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:05.261661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e2785ba4-9e5d-42ac-a5fa-ec019757fc9c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:05.263006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e2785ba4-9e5d-42ac-a5fa-ec019757fc9c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:05.272161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2785ba4-9e5d-42ac-a5fa-ec019757fc9c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:05.272666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2785ba4-9e5d-42ac-a5fa-ec019757fc9c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:05.273496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2785ba4-9e5d-42ac-a5fa-ec019757fc9c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:05.274326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2785ba4-9e5d-42ac-a5fa-ec019757fc9c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:05.402276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e2785ba4-9e5d-42ac-a5fa-ec019757fc9c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.143301 Apr 21 14:46:05.403353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 359/767] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:05 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:05.502831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:05.515425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:05.517088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:05.518366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-de3b15d0-5d9d-444e-9116-e77260ea818a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1723 microversion: 2.20 time: 0.469309 Apr 21 14:46:05.518972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 409/768] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:05 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:06.036419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3566c523-dc6d-4f2b-936f-78b4d7016bc6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:06.037171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3566c523-dc6d-4f2b-936f-78b4d7016bc6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:06.059023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3566c523-dc6d-4f2b-936f-78b4d7016bc6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:06.059803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3566c523-dc6d-4f2b-936f-78b4d7016bc6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:06.061241 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3566c523-dc6d-4f2b-936f-78b4d7016bc6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:06.062195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3566c523-dc6d-4f2b-936f-78b4d7016bc6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:06.415057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9597a68c-5eb0-4fd0-a771-808d3db24d42 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:06.416207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9597a68c-5eb0-4fd0-a771-808d3db24d42 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:06.426544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9597a68c-5eb0-4fd0-a771-808d3db24d42 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:06.427062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9597a68c-5eb0-4fd0-a771-808d3db24d42 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:06.427935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9597a68c-5eb0-4fd0-a771-808d3db24d42 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:06.428436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9597a68c-5eb0-4fd0-a771-808d3db24d42 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:06.552220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9597a68c-5eb0-4fd0-a771-808d3db24d42 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.141667 Apr 21 14:46:06.552938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 410/769] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:06 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:46:06.558977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:06.559746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:06.562544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3566c523-dc6d-4f2b-936f-78b4d7016bc6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:06.569305 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:06.569805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:06.570716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:06.571218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:06.574286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3566c523-dc6d-4f2b-936f-78b4d7016bc6 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.542352 Apr 21 14:46:06.575367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 360/770] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:06 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:06.737098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:06.747070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:06.748738 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:06.749968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c80edf46-3043-423d-8857-7bc45953c6d2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1656 microversion: 2.20 time: 0.195856 Apr 21 14:46:06.750611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 411/771] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:06 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1656 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:07.049775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-40fa6709-951d-47c9-a444-b43e9533bc1c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:07.050900 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-40fa6709-951d-47c9-a444-b43e9533bc1c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:07.059972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40fa6709-951d-47c9-a444-b43e9533bc1c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.060511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40fa6709-951d-47c9-a444-b43e9533bc1c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.061395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40fa6709-951d-47c9-a444-b43e9533bc1c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.061848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40fa6709-951d-47c9-a444-b43e9533bc1c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.250087 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-40fa6709-951d-47c9-a444-b43e9533bc1c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lazy-loading 'services' on Instance uuid f2221873-b3ba-4ade-b6ec-61c700a9d453 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:46:07.288286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-c501c71f-4bff-423d-8622-07b60e261056 req-e69e3885-151e-4d05-8f59-106d76d6c492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf3aa87-b02a-4b58-901a-76f4e825e75a", "name": "network-vif-deleted", "tag": "245817c6-3c22-47d2-a7ad-82a9d1f0181d"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:07.290097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:46:07.290097 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:46:07.300291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c501c71f-4bff-423d-8622-07b60e261056 req-e69e3885-151e-4d05-8f59-106d76d6c492 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.300808 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c501c71f-4bff-423d-8622-07b60e261056 req-e69e3885-151e-4d05-8f59-106d76d6c492 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.321118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-c501c71f-4bff-423d-8622-07b60e261056 req-e69e3885-151e-4d05-8f59-106d76d6c492 service nova] Creating event network-vif-deleted:245817c6-3c22-47d2-a7ad-82a9d1f0181d for instance abf3aa87-b02a-4b58-901a-76f4e825e75a on hv-cinder-78638 Apr 21 14:46:07.332089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-c501c71f-4bff-423d-8622-07b60e261056 req-e69e3885-151e-4d05-8f59-106d76d6c492 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046247 Apr 21 14:46:07.332089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 412/772] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:46:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:46:07.431891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-40fa6709-951d-47c9-a444-b43e9533bc1c tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453/os-volume_attachments/9992e463-665a-4703-a69a-72af36ab612a" status: 202 len: 0 microversion: 2.1 time: 0.385673 Apr 21 14:46:07.432692 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 361/773] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:46:07 2021] DELETE /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453/os-volume_attachments/9992e463-665a-4703-a69a-72af36ab612a => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:46:07.566795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-69bf602d-b268-4c08-8f83-133978afe24e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:07.567985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-69bf602d-b268-4c08-8f83-133978afe24e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:07.589189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-69bf602d-b268-4c08-8f83-133978afe24e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.589714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-69bf602d-b268-4c08-8f83-133978afe24e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.590661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-69bf602d-b268-4c08-8f83-133978afe24e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.591161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-69bf602d-b268-4c08-8f83-133978afe24e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.603547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e8db385-132f-4797-9960-6803e616bcf5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:07.604822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7e8db385-132f-4797-9960-6803e616bcf5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:07.631988 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e8db385-132f-4797-9960-6803e616bcf5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.632869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e8db385-132f-4797-9960-6803e616bcf5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.640455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e8db385-132f-4797-9960-6803e616bcf5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.640455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e8db385-132f-4797-9960-6803e616bcf5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.773104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-69bf602d-b268-4c08-8f83-133978afe24e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.210973 Apr 21 14:46:07.774224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 413/774] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:07 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:07.785628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:07.786451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:07.796298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.796808 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.797687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.798250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.930100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:07.930985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:07.931742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lazy-loading 'fault' on Instance uuid abf3aa87-b02a-4b58-901a-76f4e825e75a {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:46:07.943775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7e8db385-132f-4797-9960-6803e616bcf5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:07.954248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7e8db385-132f-4797-9960-6803e616bcf5 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.358548 Apr 21 14:46:07.957144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 362/775] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:07 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:08.071064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:08.081591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:08.083358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:08.084630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2b9704cb-def3-47f3-8ff1-52568038f12b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 200 len: 1371 microversion: 2.20 time: 0.304084 Apr 21 14:46:08.085263 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 414/776] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:07 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:08.719353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cf74479b-81bd-4bd3-b368-4e8c0d633e87 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:08.720237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cf74479b-81bd-4bd3-b368-4e8c0d633e87 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:08.733597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf74479b-81bd-4bd3-b368-4e8c0d633e87 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:08.734431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf74479b-81bd-4bd3-b368-4e8c0d633e87 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:08.735324 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf74479b-81bd-4bd3-b368-4e8c0d633e87 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:08.735816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf74479b-81bd-4bd3-b368-4e8c0d633e87 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:08.785462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9eb555f4-6be3-4806-8598-fa89f286303e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:08.786874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9eb555f4-6be3-4806-8598-fa89f286303e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:08.809604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9eb555f4-6be3-4806-8598-fa89f286303e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:08.810476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9eb555f4-6be3-4806-8598-fa89f286303e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:08.811834 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9eb555f4-6be3-4806-8598-fa89f286303e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:08.812506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9eb555f4-6be3-4806-8598-fa89f286303e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:08.823952 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cf74479b-81bd-4bd3-b368-4e8c0d633e87 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:46:08.972613 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9eb555f4-6be3-4806-8598-fa89f286303e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.190552 Apr 21 14:46:08.974113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 415/777] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:08 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:08.996574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-867d662d-c82e-4b39-ab1f-9c1ee77a7101 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:09.011644 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-867d662d-c82e-4b39-ab1f-9c1ee77a7101 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:09.031343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-867d662d-c82e-4b39-ab1f-9c1ee77a7101 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:09.032298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-867d662d-c82e-4b39-ab1f-9c1ee77a7101 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:09.034172 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-867d662d-c82e-4b39-ab1f-9c1ee77a7101 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:09.034983 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-867d662d-c82e-4b39-ab1f-9c1ee77a7101 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:09.089467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cf74479b-81bd-4bd3-b368-4e8c0d633e87 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 204 len: 0 microversion: 2.1 time: 0.374204 Apr 21 14:46:09.090476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 363/778] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:46:08 2021] DELETE /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:46:09.106697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ea130efb-bc3f-4b44-946c-dd7016b48af3 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:09.108051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ea130efb-bc3f-4b44-946c-dd7016b48af3 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:09.120935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea130efb-bc3f-4b44-946c-dd7016b48af3 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:09.121709 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea130efb-bc3f-4b44-946c-dd7016b48af3 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:09.123392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea130efb-bc3f-4b44-946c-dd7016b48af3 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:09.124095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea130efb-bc3f-4b44-946c-dd7016b48af3 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:09.423619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ea130efb-bc3f-4b44-946c-dd7016b48af3 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:09.437441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-867d662d-c82e-4b39-ab1f-9c1ee77a7101 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:09.440960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ea130efb-bc3f-4b44-946c-dd7016b48af3 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1515 microversion: 2.1 time: 0.342881 Apr 21 14:46:09.442698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 364/779] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:09 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1515 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:09.448627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-867d662d-c82e-4b39-ab1f-9c1ee77a7101 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.472362 Apr 21 14:46:09.449418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 416/780] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:08 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:09.460367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f27a4004-e319-4f97-be5d-233658dd265f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:09.461713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f27a4004-e319-4f97-be5d-233658dd265f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:09.472568 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f27a4004-e319-4f97-be5d-233658dd265f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:09.473065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f27a4004-e319-4f97-be5d-233658dd265f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:09.473908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f27a4004-e319-4f97-be5d-233658dd265f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:09.474478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f27a4004-e319-4f97-be5d-233658dd265f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:09.552843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-f27a4004-e319-4f97-be5d-233658dd265f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] HTTP exception thrown: Instance abf3aa87-b02a-4b58-901a-76f4e825e75a could not be found. Apr 21 14:46:09.554156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f27a4004-e319-4f97-be5d-233658dd265f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Returning 404 to user: Instance abf3aa87-b02a-4b58-901a-76f4e825e75a could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:46:09.555651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f27a4004-e319-4f97-be5d-233658dd265f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 404 len: 111 microversion: 2.20 time: 0.111490 Apr 21 14:46:09.556851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 365/781] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:09 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:46:09.568854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3d2c2be1-3634-4c98-b2a4-80fb3599102f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '.version_select at 0x7f19e3cdc0d0>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:09.598394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3d2c2be1-3634-4c98-b2a4-80fb3599102f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218522724" status: 204 len: 0 microversion: 2.20 time: 0.034077 Apr 21 14:46:09.599009 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 417/782] 10.222.0.24 () {60 vars in 1252 bytes} [Wed Apr 21 14:46:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218522724 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:46:09.985424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-56f71d90-3390-472a-9d61-286136d1a583 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:09.986699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-56f71d90-3390-472a-9d61-286136d1a583 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:10.006012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56f71d90-3390-472a-9d61-286136d1a583 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:10.006526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56f71d90-3390-472a-9d61-286136d1a583 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:10.007400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56f71d90-3390-472a-9d61-286136d1a583 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:10.007886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56f71d90-3390-472a-9d61-286136d1a583 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:10.186526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-56f71d90-3390-472a-9d61-286136d1a583 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.204899 Apr 21 14:46:10.187355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 366/783] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:09 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:10.461542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1018126c-1ec0-4df9-8b5d-f7ec937582f2 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:10.462246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1018126c-1ec0-4df9-8b5d-f7ec937582f2 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:10.475641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-92fdf9ec-861f-4f6d-a81d-9bb872590121 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:10.476371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-92fdf9ec-861f-4f6d-a81d-9bb872590121 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:10.477773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1018126c-1ec0-4df9-8b5d-f7ec937582f2 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:10.478559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1018126c-1ec0-4df9-8b5d-f7ec937582f2 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:10.479658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1018126c-1ec0-4df9-8b5d-f7ec937582f2 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:10.480434 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1018126c-1ec0-4df9-8b5d-f7ec937582f2 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:10.485276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-92fdf9ec-861f-4f6d-a81d-9bb872590121 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:10.485788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-92fdf9ec-861f-4f6d-a81d-9bb872590121 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:10.486763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-92fdf9ec-861f-4f6d-a81d-9bb872590121 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:10.487229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-92fdf9ec-861f-4f6d-a81d-9bb872590121 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:10.725810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-92fdf9ec-861f-4f6d-a81d-9bb872590121 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:10.750334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-92fdf9ec-861f-4f6d-a81d-9bb872590121 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.279385 Apr 21 14:46:10.751343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 367/784] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:10 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:46:10.888835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1018126c-1ec0-4df9-8b5d-f7ec937582f2 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:10.901864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1018126c-1ec0-4df9-8b5d-f7ec937582f2 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1515 microversion: 2.1 time: 0.444851 Apr 21 14:46:10.902777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 418/785] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:10 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1515 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:10.930935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ced4b033-288a-4f05-b6fc-97a5998a19d6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'create', calling method: .version_select at 0x7f19dfc2b0d0>, body: {"keypair": {"name": "tempest-keypair-581730087"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:10.956120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ced4b033-288a-4f05-b6fc-97a5998a19d6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:46:10.960859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ced4b033-288a-4f05-b6fc-97a5998a19d6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for user ff12725509264be384462a84ea6aaf64 and project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:46:11.205239 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3ee6be77-b8cb-4866-b056-ada4cf6ced46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:11.207560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3ee6be77-b8cb-4866-b056-ada4cf6ced46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:11.216470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ced4b033-288a-4f05-b6fc-97a5998a19d6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:46:11.222378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ee6be77-b8cb-4866-b056-ada4cf6ced46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:11.223451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ee6be77-b8cb-4866-b056-ada4cf6ced46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:11.224121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ced4b033-288a-4f05-b6fc-97a5998a19d6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for user ff12725509264be384462a84ea6aaf64 and project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:46:11.225262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ee6be77-b8cb-4866-b056-ada4cf6ced46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:11.226318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ee6be77-b8cb-4866-b056-ada4cf6ced46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:11.240193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ced4b033-288a-4f05-b6fc-97a5998a19d6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.314459 Apr 21 14:46:11.241413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 368/786] 10.222.0.24 () {62 vars in 1189 bytes} [Wed Apr 21 14:46:10 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 317 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:46:11.398562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3ee6be77-b8cb-4866-b056-ada4cf6ced46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.201193 Apr 21 14:46:11.401183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 419/787] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:11 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:11.770729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-892f6d73-778e-46f3-bf2c-b0c6e05dc987 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:11.770970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-892f6d73-778e-46f3-bf2c-b0c6e05dc987 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:11.780747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-778e-46f3-bf2c-b0c6e05dc987 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:11.781396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-778e-46f3-bf2c-b0c6e05dc987 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:11.782283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-778e-46f3-bf2c-b0c6e05dc987 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:11.784049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-778e-46f3-bf2c-b0c6e05dc987 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:11.931354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1c9efba2-ab09-4506-9024-d34e70f423b7 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:11.932162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1c9efba2-ab09-4506-9024-d34e70f423b7 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:11.950295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c9efba2-ab09-4506-9024-d34e70f423b7 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:11.951145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c9efba2-ab09-4506-9024-d34e70f423b7 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:11.952770 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c9efba2-ab09-4506-9024-d34e70f423b7 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:11.953659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c9efba2-ab09-4506-9024-d34e70f423b7 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:12.374950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c9efba2-ab09-4506-9024-d34e70f423b7 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:12.389876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1c9efba2-ab09-4506-9024-d34e70f423b7 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1515 microversion: 2.1 time: 0.470053 Apr 21 14:46:12.401088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 420/788] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:11 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1515 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:12.416316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0a850545-53e0-4056-9827-52be5232e637 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:12.417388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0a850545-53e0-4056-9827-52be5232e637 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:12.430946 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a850545-53e0-4056-9827-52be5232e637 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:12.433026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a850545-53e0-4056-9827-52be5232e637 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:12.434885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a850545-53e0-4056-9827-52be5232e637 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:12.435681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a850545-53e0-4056-9827-52be5232e637 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:12.551996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0a850545-53e0-4056-9827-52be5232e637 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.139248 Apr 21 14:46:12.554105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 421/789] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:12 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:12.741131 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-892f6d73-778e-46f3-bf2c-b0c6e05dc987 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:12.766213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-892f6d73-778e-46f3-bf2c-b0c6e05dc987 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 1.000651 Apr 21 14:46:12.767723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 369/790] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:11 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:13.382948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6b0b9a46-b02f-4412-bca9-82b364f62a95 req-a78e8ad3-e331-44af-a82c-df9848797d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2221873-b3ba-4ade-b6ec-61c700a9d453", "name": "network-vif-deleted", "tag": "4a662801-d937-4aba-8a74-2b8638623e05"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:13.385395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:46:13.385395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:46:13.398620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6b0b9a46-b02f-4412-bca9-82b364f62a95 req-a78e8ad3-e331-44af-a82c-df9848797d73 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:13.409253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6b0b9a46-b02f-4412-bca9-82b364f62a95 req-a78e8ad3-e331-44af-a82c-df9848797d73 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:13.410886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f9bf3cbb-8d18-4ed9-a2ea-7975af030ec6 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:13.411676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9bf3cbb-8d18-4ed9-a2ea-7975af030ec6 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:13.423026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bf3cbb-8d18-4ed9-a2ea-7975af030ec6 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:13.423540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bf3cbb-8d18-4ed9-a2ea-7975af030ec6 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:13.424863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bf3cbb-8d18-4ed9-a2ea-7975af030ec6 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:13.426188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bf3cbb-8d18-4ed9-a2ea-7975af030ec6 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:13.429914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6b0b9a46-b02f-4412-bca9-82b364f62a95 req-a78e8ad3-e331-44af-a82c-df9848797d73 service nova] Creating event network-vif-deleted:4a662801-d937-4aba-8a74-2b8638623e05 for instance f2221873-b3ba-4ade-b6ec-61c700a9d453 on hv-cinder-78638 Apr 21 14:46:13.437168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6b0b9a46-b02f-4412-bca9-82b364f62a95 req-a78e8ad3-e331-44af-a82c-df9848797d73 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060855 Apr 21 14:46:13.438683 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 422/791] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:46:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:46:13.572902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4363c9de-54dc-4e15-b6bd-99b4d11092ad tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:13.575509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4363c9de-54dc-4e15-b6bd-99b4d11092ad tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:13.596642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4363c9de-54dc-4e15-b6bd-99b4d11092ad tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:13.597143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4363c9de-54dc-4e15-b6bd-99b4d11092ad tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:13.598125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4363c9de-54dc-4e15-b6bd-99b4d11092ad tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:13.598606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4363c9de-54dc-4e15-b6bd-99b4d11092ad tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:13.602546 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f9bf3cbb-8d18-4ed9-a2ea-7975af030ec6 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc678f433f0494abf27ca6f1ccb53ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0e6515053422b8185d7532e81af1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:13.612688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f9bf3cbb-8d18-4ed9-a2ea-7975af030ec6 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 200 len: 1304 microversion: 2.1 time: 0.206412 Apr 21 14:46:13.613218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 370/792] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:13 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 1304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:46:13.618766 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-206732836", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4398a4b8-9ecd-43b2-988b-da3ccd660ad9"}], "security_groups": [{"name": "tempest-securitygroup--1384848179"}], "key_name": "tempest-keypair-581730087", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:13.705720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4363c9de-54dc-4e15-b6bd-99b4d11092ad tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.143489 Apr 21 14:46:13.706761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 423/793] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:13 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:46:13.749209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] validate_networks() for [('4398a4b8-9ecd-43b2-988b-da3ccd660ad9', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:46:13.788873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0ae630f0-6be3-45cc-bc49-b06d8b0a404e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:13.789510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0ae630f0-6be3-45cc-bc49-b06d8b0a404e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:13.799448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ae630f0-6be3-45cc-bc49-b06d8b0a404e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:13.800315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ae630f0-6be3-45cc-bc49-b06d8b0a404e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:13.801188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ae630f0-6be3-45cc-bc49-b06d8b0a404e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:13.801675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ae630f0-6be3-45cc-bc49-b06d8b0a404e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:14.057150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0ae630f0-6be3-45cc-bc49-b06d8b0a404e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:14.067304 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0ae630f0-6be3-45cc-bc49-b06d8b0a404e tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.283262 Apr 21 14:46:14.068360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 424/794] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:13 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:14.474167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:46:14.474764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:46:14.475511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:46:14.476711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:46:14.476899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:46:14.491297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:14.491944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:14.492892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:14.493452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:14.513386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:46:14.518006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Getting quotas for user ff12725509264be384462a84ea6aaf64 and project b0771cc9ab3c4a23881ef55e4b3218b3. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:46:14.529957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:46:14.532678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:46:14.589229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d51ce168-f03e-4ccf-a09e-7732b525008c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.974762 Apr 21 14:46:14.589843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 371/795] 10.222.0.24 () {62 vars in 1178 bytes} [Wed Apr 21 14:46:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 21 14:46:14.600858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b7aa73fa-e83a-40f5-8666-a7ed83c7a54d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:14.601691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b7aa73fa-e83a-40f5-8666-a7ed83c7a54d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:14.632539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab439cc8-5e11-4f3e-9dde-3db146502079 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:14.633423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ab439cc8-5e11-4f3e-9dde-3db146502079 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] [instance: f2221873-b3ba-4ade-b6ec-61c700a9d453] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:14.644412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab439cc8-5e11-4f3e-9dde-3db146502079 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:14.644987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab439cc8-5e11-4f3e-9dde-3db146502079 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:14.645746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab439cc8-5e11-4f3e-9dde-3db146502079 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:14.646280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab439cc8-5e11-4f3e-9dde-3db146502079 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:14.710985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-ab439cc8-5e11-4f3e-9dde-3db146502079 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] HTTP exception thrown: Instance f2221873-b3ba-4ade-b6ec-61c700a9d453 could not be found. Apr 21 14:46:14.711783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab439cc8-5e11-4f3e-9dde-3db146502079 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] Returning 404 to user: Instance f2221873-b3ba-4ade-b6ec-61c700a9d453 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:46:14.712976 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ab439cc8-5e11-4f3e-9dde-3db146502079 tempest-VolumesSnapshotTestJSON-1265311213 tempest-VolumesSnapshotTestJSON-1265311213-project] 10.222.0.24 "GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453" status: 404 len: 111 microversion: 2.1 time: 0.085561 Apr 21 14:46:14.713665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 372/796] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:14 2021] GET /compute/v2.1/servers/f2221873-b3ba-4ade-b6ec-61c700a9d453 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:46:14.719316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a4974cd2-e3c3-4d4d-ac34-af38e0ae0faf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:14.721133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a4974cd2-e3c3-4d4d-ac34-af38e0ae0faf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:14.727769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b7aa73fa-e83a-40f5-8666-a7ed83c7a54d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:14.739545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b7aa73fa-e83a-40f5-8666-a7ed83c7a54d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:14.741494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4974cd2-e3c3-4d4d-ac34-af38e0ae0faf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:14.742171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b7aa73fa-e83a-40f5-8666-a7ed83c7a54d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:14.743582 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b7aa73fa-e83a-40f5-8666-a7ed83c7a54d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1280 microversion: 2.20 time: 0.146837 Apr 21 14:46:14.744301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4974cd2-e3c3-4d4d-ac34-af38e0ae0faf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:14.744536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 425/797] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:14 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:14.754376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4974cd2-e3c3-4d4d-ac34-af38e0ae0faf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:14.754376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4974cd2-e3c3-4d4d-ac34-af38e0ae0faf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:14.863244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a4974cd2-e3c3-4d4d-ac34-af38e0ae0faf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.147905 Apr 21 14:46:14.864290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 373/798] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:14 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:15.087737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f0736144-d4be-42c6-9872-05b0ec7e0446 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:15.089258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f0736144-d4be-42c6-9872-05b0ec7e0446 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:15.101714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0736144-d4be-42c6-9872-05b0ec7e0446 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:15.102345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0736144-d4be-42c6-9872-05b0ec7e0446 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:15.103320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0736144-d4be-42c6-9872-05b0ec7e0446 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:15.103910 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0736144-d4be-42c6-9872-05b0ec7e0446 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:15.375248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f0736144-d4be-42c6-9872-05b0ec7e0446 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:15.386673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f0736144-d4be-42c6-9872-05b0ec7e0446 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.304231 Apr 21 14:46:15.387380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 426/799] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:15 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:15.766477 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:15.767382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:15.777452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:15.778127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:15.778974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:15.779466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:15.876120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-19e5a89c-3c32-4ab5-abee-4c8d5a9022f3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:15.877222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-19e5a89c-3c32-4ab5-abee-4c8d5a9022f3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:15.887140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-19e5a89c-3c32-4ab5-abee-4c8d5a9022f3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:15.887883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-19e5a89c-3c32-4ab5-abee-4c8d5a9022f3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:15.891766 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-19e5a89c-3c32-4ab5-abee-4c8d5a9022f3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:15.893014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-19e5a89c-3c32-4ab5-abee-4c8d5a9022f3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:15.963694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:15.982145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:15.987071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:15.988681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-94ffb80c-2382-4a96-802d-cbe53e79c992 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1332 microversion: 2.20 time: 0.227826 Apr 21 14:46:15.990242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 374/800] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:15 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1332 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:16.115854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-19e5a89c-3c32-4ab5-abee-4c8d5a9022f3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.243642 Apr 21 14:46:16.117350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 427/801] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:15 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:46:16.405810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-074074db-c254-4cc1-b212-0a9f6ae2a413 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:16.406588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-074074db-c254-4cc1-b212-0a9f6ae2a413 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:16.419747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-074074db-c254-4cc1-b212-0a9f6ae2a413 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:16.420242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-074074db-c254-4cc1-b212-0a9f6ae2a413 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:16.421352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-074074db-c254-4cc1-b212-0a9f6ae2a413 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:16.421857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-074074db-c254-4cc1-b212-0a9f6ae2a413 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:16.830557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-074074db-c254-4cc1-b212-0a9f6ae2a413 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:16.840366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-074074db-c254-4cc1-b212-0a9f6ae2a413 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1508 microversion: 2.1 time: 0.438577 Apr 21 14:46:16.840975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 375/802] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:16 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:16.859087 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5377089a-978d-48b4-9e40-2b269b8c8a67 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:16.859929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5377089a-978d-48b4-9e40-2b269b8c8a67 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:16.869063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5377089a-978d-48b4-9e40-2b269b8c8a67 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:16.869573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5377089a-978d-48b4-9e40-2b269b8c8a67 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:16.870524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5377089a-978d-48b4-9e40-2b269b8c8a67 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:16.870957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5377089a-978d-48b4-9e40-2b269b8c8a67 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:17.022301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:17.023457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:17.030307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5377089a-978d-48b4-9e40-2b269b8c8a67 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "POST /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7/action" status: 202 len: 0 microversion: 2.1 time: 0.175359 Apr 21 14:46:17.031040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 428/803] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:16 2021] POST /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:46:17.036715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:17.037549 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:17.039281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:17.040262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9f3e6f86-9633-4430-a776-df66f025cf68 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:17.040527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:17.040912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9f3e6f86-9633-4430-a776-df66f025cf68 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:17.051531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f3e6f86-9633-4430-a776-df66f025cf68 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:17.052643 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f3e6f86-9633-4430-a776-df66f025cf68 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:17.053668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f3e6f86-9633-4430-a776-df66f025cf68 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:17.055117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f3e6f86-9633-4430-a776-df66f025cf68 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:17.293481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f3e6f86-9633-4430-a776-df66f025cf68 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:17.304037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9f3e6f86-9633-4430-a776-df66f025cf68 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1516 microversion: 2.1 time: 0.267674 Apr 21 14:46:17.314289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 429/804] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:17 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:17.314289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b4e45618-9e09-40fa-a471-c72a11b73bf3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:17.314289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b4e45618-9e09-40fa-a471-c72a11b73bf3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:17.321798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4e45618-9e09-40fa-a471-c72a11b73bf3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:17.321798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4e45618-9e09-40fa-a471-c72a11b73bf3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:17.321798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4e45618-9e09-40fa-a471-c72a11b73bf3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:17.322323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4e45618-9e09-40fa-a471-c72a11b73bf3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:17.565814 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:17.583166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:17.585093 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:17.586411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9654139d-dfab-41ba-81e3-75f7ca7722fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.570115 Apr 21 14:46:17.599781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 376/805] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:17 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:46:17.604921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b4e45618-9e09-40fa-a471-c72a11b73bf3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.298758 Apr 21 14:46:17.605709 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 430/806] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:17 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:18.325924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9a19de9a-e8ac-4d76-89cd-dddeb66ae43f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:18.326560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9a19de9a-e8ac-4d76-89cd-dddeb66ae43f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:18.335478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a19de9a-e8ac-4d76-89cd-dddeb66ae43f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:18.335978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a19de9a-e8ac-4d76-89cd-dddeb66ae43f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:18.336820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a19de9a-e8ac-4d76-89cd-dddeb66ae43f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:18.337301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a19de9a-e8ac-4d76-89cd-dddeb66ae43f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:18.608274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:18.609341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:18.619729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:18.620472 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:18.621515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:18.622264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:18.870986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a19de9a-e8ac-4d76-89cd-dddeb66ae43f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:18.884637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9a19de9a-e8ac-4d76-89cd-dddeb66ae43f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1516 microversion: 2.1 time: 0.563016 Apr 21 14:46:18.890444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 377/807] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:18 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1516 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:18.896635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0242d2d8-d690-45c7-81b7-667773cc47c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:18.897731 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0242d2d8-d690-45c7-81b7-667773cc47c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:18.906639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0242d2d8-d690-45c7-81b7-667773cc47c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:18.907498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0242d2d8-d690-45c7-81b7-667773cc47c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:18.908401 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0242d2d8-d690-45c7-81b7-667773cc47c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:18.909139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0242d2d8-d690-45c7-81b7-667773cc47c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:18.953346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:18.963995 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:18.965319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:18.966554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e865f18f-2325-4cf2-8adf-4f55cdffe88f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.364028 Apr 21 14:46:18.978629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 431/808] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:18 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:18.983994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-c058c338-8533-418b-8b05-dc0c1a5795e2 req-fb42280b-d727-409f-aed6-e151e292fadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ad6998-eddd-4b1f-b1f8-adada36a72a7", "name": "network-vif-unplugged", "status": "completed", "tag": "cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:18.986418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:46:18.986418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:46:18.999900 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c058c338-8533-418b-8b05-dc0c1a5795e2 req-fb42280b-d727-409f-aed6-e151e292fadf service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:18.999900 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c058c338-8533-418b-8b05-dc0c1a5795e2 req-fb42280b-d727-409f-aed6-e151e292fadf service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:19.020789 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.compute.server_external_events [req-c058c338-8533-418b-8b05-dc0c1a5795e2 req-fb42280b-d727-409f-aed6-e151e292fadf service nova] Unable to find a host for instance 96ad6998-eddd-4b1f-b1f8-adada36a72a7. Dropping event network-vif-unplugged {{(pid=100564) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 21 14:46:19.021768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-c058c338-8533-418b-8b05-dc0c1a5795e2 req-fb42280b-d727-409f-aed6-e151e292fadf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041977 Apr 21 14:46:19.022873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 432/809] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:46:18 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 21 14:46:19.121765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-b6261f49-3591-4545-aef4-5f6a8c7305f9 req-6d53cb9b-8b5a-42e2-8081-2ce538246b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b1c253-7437-4a43-bc08-a0626125cd82", "tag": "cc544713-b84a-4e45-b04d-b437a6b4c09b"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:19.123552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:46:19.123552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:46:19.133123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b6261f49-3591-4545-aef4-5f6a8c7305f9 req-6d53cb9b-8b5a-42e2-8081-2ce538246b8f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:19.133638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b6261f49-3591-4545-aef4-5f6a8c7305f9 req-6d53cb9b-8b5a-42e2-8081-2ce538246b8f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:19.153198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-b6261f49-3591-4545-aef4-5f6a8c7305f9 req-6d53cb9b-8b5a-42e2-8081-2ce538246b8f service nova] Creating event network-changed:cc544713-b84a-4e45-b04d-b437a6b4c09b for instance 77b1c253-7437-4a43-bc08-a0626125cd82 on hv-cinder-78638 Apr 21 14:46:19.158417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-b6261f49-3591-4545-aef4-5f6a8c7305f9 req-6d53cb9b-8b5a-42e2-8081-2ce538246b8f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040713 Apr 21 14:46:19.159086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 433/810] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:46:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:46:19.904261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-936aaeda-e023-433e-aaf6-36e685d5fda7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:19.905101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-936aaeda-e023-433e-aaf6-36e685d5fda7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:19.917326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-936aaeda-e023-433e-aaf6-36e685d5fda7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:19.917817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-936aaeda-e023-433e-aaf6-36e685d5fda7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:19.918706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-936aaeda-e023-433e-aaf6-36e685d5fda7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:19.919191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-936aaeda-e023-433e-aaf6-36e685d5fda7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:20.143206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-936aaeda-e023-433e-aaf6-36e685d5fda7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:20.152891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-936aaeda-e023-433e-aaf6-36e685d5fda7 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1518 microversion: 2.1 time: 0.254003 Apr 21 14:46:20.153550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 434/811] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:19 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:46:20.158494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:20.159156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:20.168032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:20.168542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:20.169396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:20.169979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:20.394904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:20.405033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:20.406744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:20.407922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-250c0032-3bc6-48de-bc59-3f8aa2cee5c4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.253286 Apr 21 14:46:20.408627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 435/812] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:20 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:21.075271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0242d2d8-d690-45c7-81b7-667773cc47c1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 2.182590 Apr 21 14:46:21.075928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 378/813] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:18 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:21.172169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9084330d-5bba-4035-82b0-6b3a96684b85 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:21.172865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9084330d-5bba-4035-82b0-6b3a96684b85 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:21.181890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9084330d-5bba-4035-82b0-6b3a96684b85 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:21.182426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9084330d-5bba-4035-82b0-6b3a96684b85 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:21.183303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9084330d-5bba-4035-82b0-6b3a96684b85 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:21.183795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9084330d-5bba-4035-82b0-6b3a96684b85 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:21.419829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9084330d-5bba-4035-82b0-6b3a96684b85 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:21.430765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:21.431534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:21.437258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9084330d-5bba-4035-82b0-6b3a96684b85 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1518 microversion: 2.1 time: 0.268703 Apr 21 14:46:21.438554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 436/814] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:21 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1518 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:21.440708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:21.441212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:21.442105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:21.442595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:21.887650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:21.897658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:21.899438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:21.900625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f8831db0-b325-46da-b51a-d203b2884b5e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.475973 Apr 21 14:46:21.901252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 379/815] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:21 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:46:22.088341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c1dde833-0667-4da7-bb1d-545f648c9efd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:22.089409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c1dde833-0667-4da7-bb1d-545f648c9efd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:22.102150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1dde833-0667-4da7-bb1d-545f648c9efd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:22.102603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1dde833-0667-4da7-bb1d-545f648c9efd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:22.103472 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1dde833-0667-4da7-bb1d-545f648c9efd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:22.103967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1dde833-0667-4da7-bb1d-545f648c9efd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:22.218350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c1dde833-0667-4da7-bb1d-545f648c9efd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.133785 Apr 21 14:46:22.220350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 437/816] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:22 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:22.456238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d930a642-38ca-4407-b476-8b23dfcf7b5f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:22.456818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d930a642-38ca-4407-b476-8b23dfcf7b5f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:22.465912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d930a642-38ca-4407-b476-8b23dfcf7b5f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:22.466312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d930a642-38ca-4407-b476-8b23dfcf7b5f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:22.467189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d930a642-38ca-4407-b476-8b23dfcf7b5f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:22.467668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d930a642-38ca-4407-b476-8b23dfcf7b5f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:22.903285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d930a642-38ca-4407-b476-8b23dfcf7b5f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:22.913050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d930a642-38ca-4407-b476-8b23dfcf7b5f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1518 microversion: 2.1 time: 0.460876 Apr 21 14:46:22.915780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 380/817] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:22 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1518 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:22.921224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:22.922333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:22.932374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:22.932841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:22.933882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:22.934632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:23.232254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1f071301-befd-4ccc-8cb7-d9269c0573e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:23.233365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1f071301-befd-4ccc-8cb7-d9269c0573e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:23.242762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f071301-befd-4ccc-8cb7-d9269c0573e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:23.243357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f071301-befd-4ccc-8cb7-d9269c0573e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:23.244335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f071301-befd-4ccc-8cb7-d9269c0573e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:23.244905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f071301-befd-4ccc-8cb7-d9269c0573e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:23.344680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:23.348103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1f071301-befd-4ccc-8cb7-d9269c0573e5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.120115 Apr 21 14:46:23.349103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 381/818] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:23 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:46:23.364204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:23.366018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:23.367376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-39e6db49-0329-491e-9b55-4881bc661301 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.450944 Apr 21 14:46:23.378854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 438/819] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:22 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:23.936875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f87d3860-e893-492f-afd9-974fcbc50056 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:23.937964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f87d3860-e893-492f-afd9-974fcbc50056 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:23.947175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f87d3860-e893-492f-afd9-974fcbc50056 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:23.947871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f87d3860-e893-492f-afd9-974fcbc50056 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:23.948710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f87d3860-e893-492f-afd9-974fcbc50056 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:23.949202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f87d3860-e893-492f-afd9-974fcbc50056 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:24.179500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f87d3860-e893-492f-afd9-974fcbc50056 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:24.189251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f87d3860-e893-492f-afd9-974fcbc50056 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.257303 Apr 21 14:46:24.190046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 382/820] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:23 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:24.361420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f12bf26-12fc-4f76-8606-7cde1c682ab0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:24.362423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f12bf26-12fc-4f76-8606-7cde1c682ab0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:24.371962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f12bf26-12fc-4f76-8606-7cde1c682ab0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:24.372506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f12bf26-12fc-4f76-8606-7cde1c682ab0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:24.373368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f12bf26-12fc-4f76-8606-7cde1c682ab0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:24.373829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f12bf26-12fc-4f76-8606-7cde1c682ab0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:24.386512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:24.387225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:24.396123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:24.396692 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:24.397748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:24.398315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:24.620048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f12bf26-12fc-4f76-8606-7cde1c682ab0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.262456 Apr 21 14:46:24.620680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 439/821] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:24 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:24.625695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:24.636533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:24.638267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:24.639439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c2dedeaa-3dc7-4497-9cd1-29a80ca29c14 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.257395 Apr 21 14:46:24.640070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 383/822] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:24 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:25.208917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9a9f8206-3618-47f3-a4d2-4d03f8f6fe14 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:25.209730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9a9f8206-3618-47f3-a4d2-4d03f8f6fe14 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:25.219060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a9f8206-3618-47f3-a4d2-4d03f8f6fe14 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:25.219574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a9f8206-3618-47f3-a4d2-4d03f8f6fe14 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:25.220421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a9f8206-3618-47f3-a4d2-4d03f8f6fe14 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:25.220912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a9f8206-3618-47f3-a4d2-4d03f8f6fe14 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:25.448094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a9f8206-3618-47f3-a4d2-4d03f8f6fe14 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:25.457713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9a9f8206-3618-47f3-a4d2-4d03f8f6fe14 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.253546 Apr 21 14:46:25.458414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 440/823] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:25 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:25.633107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0e3324b1-7a70-40d9-8cb8-acf94181744a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:25.634382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0e3324b1-7a70-40d9-8cb8-acf94181744a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:25.643841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e3324b1-7a70-40d9-8cb8-acf94181744a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:25.643841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e3324b1-7a70-40d9-8cb8-acf94181744a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:25.644653 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e3324b1-7a70-40d9-8cb8-acf94181744a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:25.645147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e3324b1-7a70-40d9-8cb8-acf94181744a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:25.659363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:25.660039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:25.671229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:25.671737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:25.672582 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:25.673073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:25.752746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0e3324b1-7a70-40d9-8cb8-acf94181744a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.123457 Apr 21 14:46:25.753863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 384/824] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:25 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:25.899521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:25.909901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:25.911695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:25.913456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d1cde3b0-2ea0-4773-ab1e-0e41930321c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.258344 Apr 21 14:46:25.914334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 441/825] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:25 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:26.477490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab4fa694-cfbf-4580-9a2b-29193565ac59 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:26.478803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ab4fa694-cfbf-4580-9a2b-29193565ac59 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:26.487696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab4fa694-cfbf-4580-9a2b-29193565ac59 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:26.488193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab4fa694-cfbf-4580-9a2b-29193565ac59 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:26.489110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab4fa694-cfbf-4580-9a2b-29193565ac59 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:26.489592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab4fa694-cfbf-4580-9a2b-29193565ac59 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:26.722126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ab4fa694-cfbf-4580-9a2b-29193565ac59 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:26.731514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ab4fa694-cfbf-4580-9a2b-29193565ac59 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.258749 Apr 21 14:46:26.732165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 385/826] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:26 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:26.765824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-60d9c3f4-0a3f-4c05-83b6-5d00f68dc5ac tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:26.767080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-60d9c3f4-0a3f-4c05-83b6-5d00f68dc5ac tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:26.776271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60d9c3f4-0a3f-4c05-83b6-5d00f68dc5ac tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:26.776793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60d9c3f4-0a3f-4c05-83b6-5d00f68dc5ac tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:26.777645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60d9c3f4-0a3f-4c05-83b6-5d00f68dc5ac tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:26.778156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60d9c3f4-0a3f-4c05-83b6-5d00f68dc5ac tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:26.880975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-60d9c3f4-0a3f-4c05-83b6-5d00f68dc5ac tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.118839 Apr 21 14:46:26.881775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 442/827] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:26 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:26.934319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:26.934993 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:26.943897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:26.944410 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:26.945267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:26.945938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:27.181635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:27.197949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:27.200194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:27.200829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1ebf5b5b-a9bc-4f2b-8786-3f0c091a3176 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.270846 Apr 21 14:46:27.201446 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 386/828] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:26 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:27.753011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b7755b91-e731-4a49-876a-54441a03f8ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:27.753829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b7755b91-e731-4a49-876a-54441a03f8ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:27.762985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7755b91-e731-4a49-876a-54441a03f8ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:27.763494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7755b91-e731-4a49-876a-54441a03f8ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:27.764407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7755b91-e731-4a49-876a-54441a03f8ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:27.764759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7755b91-e731-4a49-876a-54441a03f8ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:27.893880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc2e60b6-e826-4834-bd8f-89c76ab341ef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:27.894961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc2e60b6-e826-4834-bd8f-89c76ab341ef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:27.903824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc2e60b6-e826-4834-bd8f-89c76ab341ef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:27.904330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc2e60b6-e826-4834-bd8f-89c76ab341ef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:27.905168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc2e60b6-e826-4834-bd8f-89c76ab341ef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:27.905656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc2e60b6-e826-4834-bd8f-89c76ab341ef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:27.997098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b7755b91-e731-4a49-876a-54441a03f8ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:28.007414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b7755b91-e731-4a49-876a-54441a03f8ff tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.259004 Apr 21 14:46:28.008112 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 443/829] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:27 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:28.221692 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:28.222408 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:28.230803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:28.231313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:28.232150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:28.232714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:28.460191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:28.470243 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:28.471921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:28.473077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-148e3034-0c1d-4173-afbe-15cf1ee8085b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.255845 Apr 21 14:46:28.473714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 444/830] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:28 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:29.026647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4d9d73ce-8a98-49e1-b131-8d4f0a6e7c2b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:29.027264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4d9d73ce-8a98-49e1-b131-8d4f0a6e7c2b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:29.036208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d9d73ce-8a98-49e1-b131-8d4f0a6e7c2b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:29.036704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d9d73ce-8a98-49e1-b131-8d4f0a6e7c2b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:29.037548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d9d73ce-8a98-49e1-b131-8d4f0a6e7c2b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:29.038060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d9d73ce-8a98-49e1-b131-8d4f0a6e7c2b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:29.258314 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4d9d73ce-8a98-49e1-b131-8d4f0a6e7c2b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:29.267555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4d9d73ce-8a98-49e1-b131-8d4f0a6e7c2b tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.245033 Apr 21 14:46:29.268180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 445/831] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:29 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:29.497326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:29.498439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:29.508377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:29.508891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:29.509728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:29.510277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:29.759867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:29.772273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:29.773911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:29.775121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5e40d861-9afd-468d-bc0b-0c02366c441c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.284887 Apr 21 14:46:29.775722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 446/832] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:29 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:29.985043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc2e60b6-e826-4834-bd8f-89c76ab341ef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 2.094787 Apr 21 14:46:29.985889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 387/833] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:27 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:46:30.288107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ac8730b6-b52a-46ea-8176-02b2a5b8add1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:30.288674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ac8730b6-b52a-46ea-8176-02b2a5b8add1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:30.297255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac8730b6-b52a-46ea-8176-02b2a5b8add1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:30.297767 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac8730b6-b52a-46ea-8176-02b2a5b8add1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:30.298637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac8730b6-b52a-46ea-8176-02b2a5b8add1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:30.299132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac8730b6-b52a-46ea-8176-02b2a5b8add1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:30.534532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ac8730b6-b52a-46ea-8176-02b2a5b8add1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:30.544142 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ac8730b6-b52a-46ea-8176-02b2a5b8add1 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.260708 Apr 21 14:46:30.544719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 447/834] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:30 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:30.795810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:30.796480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:30.805852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:30.806390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:30.807224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:30.807718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:30.997412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a980eb5-7c4a-4531-b9a7-f1bab019c72b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:30.998721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a980eb5-7c4a-4531-b9a7-f1bab019c72b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:31.007429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a980eb5-7c4a-4531-b9a7-f1bab019c72b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:31.007893 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a980eb5-7c4a-4531-b9a7-f1bab019c72b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:31.008928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a980eb5-7c4a-4531-b9a7-f1bab019c72b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:31.009605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a980eb5-7c4a-4531-b9a7-f1bab019c72b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:31.055598 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:31.065486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:31.067383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:31.068671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-259ebe3e-9730-4d49-a314-a97a15c42dd0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.277720 Apr 21 14:46:31.069271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 388/835] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:30 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:31.564274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d67309e9-b327-439d-b2df-0bc1baf3bebe tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:31.564970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d67309e9-b327-439d-b2df-0bc1baf3bebe tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:31.577099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d67309e9-b327-439d-b2df-0bc1baf3bebe tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:31.577739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d67309e9-b327-439d-b2df-0bc1baf3bebe tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:31.579013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d67309e9-b327-439d-b2df-0bc1baf3bebe tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:31.579509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d67309e9-b327-439d-b2df-0bc1baf3bebe tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:31.602300 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a980eb5-7c4a-4531-b9a7-f1bab019c72b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.608622 Apr 21 14:46:31.603400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 448/836] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:30 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:31.808432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d67309e9-b327-439d-b2df-0bc1baf3bebe tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:31.819944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d67309e9-b327-439d-b2df-0bc1baf3bebe tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.260827 Apr 21 14:46:31.820642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 389/837] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:31 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:32.092147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:32.092898 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:32.101954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:32.102523 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:32.103361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:32.103852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:32.335838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:32.348709 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:32.350412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:32.351594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-87a58b18-b43e-4550-bc56-5ed2f85ef035 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.264157 Apr 21 14:46:32.352188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 449/838] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:32 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:32.615211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-53c88424-0cff-49c0-9ae8-2a998f120616 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:32.616265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-53c88424-0cff-49c0-9ae8-2a998f120616 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:32.624482 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53c88424-0cff-49c0-9ae8-2a998f120616 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:32.624992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53c88424-0cff-49c0-9ae8-2a998f120616 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:32.625819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53c88424-0cff-49c0-9ae8-2a998f120616 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:32.626340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53c88424-0cff-49c0-9ae8-2a998f120616 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:32.838841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-24ce9889-3210-4a89-9dfe-4ac4040c6408 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:32.839567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-24ce9889-3210-4a89-9dfe-4ac4040c6408 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:32.840124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-53c88424-0cff-49c0-9ae8-2a998f120616 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.228826 Apr 21 14:46:32.844386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 390/839] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:32 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:32.848274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24ce9889-3210-4a89-9dfe-4ac4040c6408 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:32.848800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24ce9889-3210-4a89-9dfe-4ac4040c6408 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:32.849663 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24ce9889-3210-4a89-9dfe-4ac4040c6408 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:32.850147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24ce9889-3210-4a89-9dfe-4ac4040c6408 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:33.083934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-24ce9889-3210-4a89-9dfe-4ac4040c6408 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:33.093590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-24ce9889-3210-4a89-9dfe-4ac4040c6408 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.258900 Apr 21 14:46:33.094259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 450/840] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:32 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:33.378186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:33.379216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:33.388538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:33.389048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:33.389878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:33.390407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:33.613171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:33.627944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:33.630569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:33.632202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5243deef-2019-4c95-bb29-ce0adabe6f35 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.258581 Apr 21 14:46:33.633136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 391/841] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:33 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:33.853968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b9dd5391-d3ec-4225-890b-af549b631953 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:33.855074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b9dd5391-d3ec-4225-890b-af549b631953 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:33.864210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9dd5391-d3ec-4225-890b-af549b631953 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:33.864668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9dd5391-d3ec-4225-890b-af549b631953 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:33.865502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9dd5391-d3ec-4225-890b-af549b631953 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:33.866002 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9dd5391-d3ec-4225-890b-af549b631953 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:33.978624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b9dd5391-d3ec-4225-890b-af549b631953 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 28739 microversion: 2.1 time: 0.128177 Apr 21 14:46:33.979586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 451/842] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:33 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 28739 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:34.112727 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5a87cca6-00cc-4ef3-b97c-316b629c2a32 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:34.113721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5a87cca6-00cc-4ef3-b97c-316b629c2a32 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:34.122817 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a87cca6-00cc-4ef3-b97c-316b629c2a32 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:34.123336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a87cca6-00cc-4ef3-b97c-316b629c2a32 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:34.124436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a87cca6-00cc-4ef3-b97c-316b629c2a32 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:34.124934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a87cca6-00cc-4ef3-b97c-316b629c2a32 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:34.360857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5a87cca6-00cc-4ef3-b97c-316b629c2a32 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:34.370753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5a87cca6-00cc-4ef3-b97c-316b629c2a32 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.262459 Apr 21 14:46:34.371557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 392/843] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:34 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:34.650856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-b0384f03-05b4-4358-bb0d-830442f84a39 req-a62b5009-08de-4afd-983d-bf25504f9587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b1c253-7437-4a43-bc08-a0626125cd82", "name": "network-vif-plugged", "status": "completed", "tag": "cc544713-b84a-4e45-b04d-b437a6b4c09b"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:34.652722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:46:34.652722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:46:34.656898 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:34.657609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:34.662702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b0384f03-05b4-4358-bb0d-830442f84a39 req-a62b5009-08de-4afd-983d-bf25504f9587 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:34.663166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b0384f03-05b4-4358-bb0d-830442f84a39 req-a62b5009-08de-4afd-983d-bf25504f9587 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:34.666712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:34.667237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:34.668092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:34.668588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:34.682242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-b0384f03-05b4-4358-bb0d-830442f84a39 req-a62b5009-08de-4afd-983d-bf25504f9587 service nova] Creating event network-vif-plugged:cc544713-b84a-4e45-b04d-b437a6b4c09b for instance 77b1c253-7437-4a43-bc08-a0626125cd82 on hv-cinder-78638 Apr 21 14:46:34.688667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-b0384f03-05b4-4358-bb0d-830442f84a39 req-a62b5009-08de-4afd-983d-bf25504f9587 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044678 Apr 21 14:46:34.689421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 452/844] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:46:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:46:34.940797 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:34.951234 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:34.952925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:34.954197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fb9ac2d8-1552-41fe-a89b-b98685f7a137 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.302166 Apr 21 14:46:34.954851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 393/845] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:34 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:34.992159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-85873736-0cc8-47b2-8efb-6f82e776704e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:34.993305 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-85873736-0cc8-47b2-8efb-6f82e776704e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:35.001570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85873736-0cc8-47b2-8efb-6f82e776704e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:35.002096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85873736-0cc8-47b2-8efb-6f82e776704e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:35.002911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85873736-0cc8-47b2-8efb-6f82e776704e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:35.003595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85873736-0cc8-47b2-8efb-6f82e776704e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:35.220566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-85873736-0cc8-47b2-8efb-6f82e776704e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 29178 microversion: 2.1 time: 0.232680 Apr 21 14:46:35.221226 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 453/846] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:34 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 29178 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:35.389261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-03e42435-f18e-4a6d-9900-8b346d8900bc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:35.389928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-03e42435-f18e-4a6d-9900-8b346d8900bc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:35.398428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03e42435-f18e-4a6d-9900-8b346d8900bc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:35.398948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03e42435-f18e-4a6d-9900-8b346d8900bc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:35.399783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03e42435-f18e-4a6d-9900-8b346d8900bc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:35.400277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03e42435-f18e-4a6d-9900-8b346d8900bc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:35.628567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-03e42435-f18e-4a6d-9900-8b346d8900bc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:35.638026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-03e42435-f18e-4a6d-9900-8b346d8900bc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.252931 Apr 21 14:46:35.638700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 394/847] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:35 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:35.974272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:35.975318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:35.984242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:35.984776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:35.985744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:35.986270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:36.211251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:36.222048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:36.223861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:36.225144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8675b042-59b0-469e-872f-7ffadd378585 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1406 microversion: 2.20 time: 0.255701 Apr 21 14:46:36.225667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 454/848] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:35 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:36.233503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-28ed4d5a-df50-4ab6-b3e0-bf51a636572c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:36.235092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-28ed4d5a-df50-4ab6-b3e0-bf51a636572c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:36.244068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28ed4d5a-df50-4ab6-b3e0-bf51a636572c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:36.244684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28ed4d5a-df50-4ab6-b3e0-bf51a636572c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:36.245622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28ed4d5a-df50-4ab6-b3e0-bf51a636572c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:36.246221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28ed4d5a-df50-4ab6-b3e0-bf51a636572c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:36.347139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-28ed4d5a-df50-4ab6-b3e0-bf51a636572c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 30833 microversion: 2.1 time: 0.117413 Apr 21 14:46:36.351470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 395/849] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:36 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 30833 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:36.656683 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed338c98-70e2-49bd-9889-8a4fbc823651 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:36.657317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ed338c98-70e2-49bd-9889-8a4fbc823651 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:36.665705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed338c98-70e2-49bd-9889-8a4fbc823651 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:36.666274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed338c98-70e2-49bd-9889-8a4fbc823651 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:36.667152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed338c98-70e2-49bd-9889-8a4fbc823651 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:36.667638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed338c98-70e2-49bd-9889-8a4fbc823651 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:36.890472 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed338c98-70e2-49bd-9889-8a4fbc823651 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:36.899821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed338c98-70e2-49bd-9889-8a4fbc823651 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.247309 Apr 21 14:46:36.900464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 455/850] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:36 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:37.245572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:37.246323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:37.255375 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:37.255893 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:37.256743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:37.257234 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:37.360340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ba6f521a-a702-4b55-933b-12732dccada6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:37.361541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ba6f521a-a702-4b55-933b-12732dccada6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:37.370580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba6f521a-a702-4b55-933b-12732dccada6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:37.371090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba6f521a-a702-4b55-933b-12732dccada6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:37.371931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba6f521a-a702-4b55-933b-12732dccada6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:37.372423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba6f521a-a702-4b55-933b-12732dccada6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:37.476933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ba6f521a-a702-4b55-933b-12732dccada6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 32738 microversion: 2.1 time: 0.120507 Apr 21 14:46:37.478010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 456/851] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:37 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 32738 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:37.489186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:37.504486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:37.506144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:37.507414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8d1b7dd2-798e-44c3-a888-506c9285863f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1598 microversion: 2.20 time: 0.266812 Apr 21 14:46:37.508018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 396/852] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:46:37 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1598 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:37.531621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e07c1d9f-b0a9-40d7-81a2-37809f131a8d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:37.532252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e07c1d9f-b0a9-40d7-81a2-37809f131a8d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:37.541079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e07c1d9f-b0a9-40d7-81a2-37809f131a8d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:37.541562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e07c1d9f-b0a9-40d7-81a2-37809f131a8d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:37.542413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e07c1d9f-b0a9-40d7-81a2-37809f131a8d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:37.542901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e07c1d9f-b0a9-40d7-81a2-37809f131a8d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:37.718023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e07c1d9f-b0a9-40d7-81a2-37809f131a8d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.190648 Apr 21 14:46:37.719024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 457/853] 10.222.0.24 () {60 vars in 1306 bytes} [Wed Apr 21 14:46:37 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:37.918852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-747d16ab-444b-4dbc-878b-dfb3b2a1595f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:37.919525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-747d16ab-444b-4dbc-878b-dfb3b2a1595f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:37.928404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-747d16ab-444b-4dbc-878b-dfb3b2a1595f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:37.928921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-747d16ab-444b-4dbc-878b-dfb3b2a1595f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:37.929764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-747d16ab-444b-4dbc-878b-dfb3b2a1595f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:37.930323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-747d16ab-444b-4dbc-878b-dfb3b2a1595f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:38.302245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-f669206a-685b-4ee4-896c-5cdf68b8f126 req-5fe027ac-5a87-4afd-bbc6-7f86f2df2dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ad6998-eddd-4b1f-b1f8-adada36a72a7", "name": "network-vif-plugged", "status": "completed", "tag": "cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:38.305220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:46:38.305220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:46:38.317031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f669206a-685b-4ee4-896c-5cdf68b8f126 req-5fe027ac-5a87-4afd-bbc6-7f86f2df2dfd service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:38.319211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f669206a-685b-4ee4-896c-5cdf68b8f126 req-5fe027ac-5a87-4afd-bbc6-7f86f2df2dfd service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:38.341746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-f669206a-685b-4ee4-896c-5cdf68b8f126 req-5fe027ac-5a87-4afd-bbc6-7f86f2df2dfd service nova] Creating event network-vif-plugged:cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7 for instance 96ad6998-eddd-4b1f-b1f8-adada36a72a7 on hv-cinder-78638 Apr 21 14:46:38.348207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-f669206a-685b-4ee4-896c-5cdf68b8f126 req-5fe027ac-5a87-4afd-bbc6-7f86f2df2dfd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052716 Apr 21 14:46:38.349436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 458/854] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:46:38.428143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-747d16ab-444b-4dbc-878b-dfb3b2a1595f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:38.437363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-747d16ab-444b-4dbc-878b-dfb3b2a1595f tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.522593 Apr 21 14:46:38.437979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 397/855] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:37 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:38.490721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d6d484cc-1264-4a90-ab62-a3d8026ba4b6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:38.491965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d6d484cc-1264-4a90-ab62-a3d8026ba4b6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:38.500630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6d484cc-1264-4a90-ab62-a3d8026ba4b6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:38.501130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6d484cc-1264-4a90-ab62-a3d8026ba4b6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:38.501969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6d484cc-1264-4a90-ab62-a3d8026ba4b6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:38.502498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6d484cc-1264-4a90-ab62-a3d8026ba4b6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:38.611104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d6d484cc-1264-4a90-ab62-a3d8026ba4b6 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 33701 microversion: 2.1 time: 0.125272 Apr 21 14:46:38.612899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 459/856] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:38 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 33701 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:39.456396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1951a064-3a61-48d8-ad6e-9ce5fcefbfda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:39.457168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1951a064-3a61-48d8-ad6e-9ce5fcefbfda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:39.467224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1951a064-3a61-48d8-ad6e-9ce5fcefbfda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:39.467645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1951a064-3a61-48d8-ad6e-9ce5fcefbfda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:39.468646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1951a064-3a61-48d8-ad6e-9ce5fcefbfda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:39.469318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1951a064-3a61-48d8-ad6e-9ce5fcefbfda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:39.626499 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-36470946-f267-4d90-8b4f-2ae81360c9ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:39.628060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-36470946-f267-4d90-8b4f-2ae81360c9ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:39.637904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36470946-f267-4d90-8b4f-2ae81360c9ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:39.638471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36470946-f267-4d90-8b4f-2ae81360c9ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:39.639328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36470946-f267-4d90-8b4f-2ae81360c9ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:39.639821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36470946-f267-4d90-8b4f-2ae81360c9ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:39.693953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1951a064-3a61-48d8-ad6e-9ce5fcefbfda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:39.706063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1951a064-3a61-48d8-ad6e-9ce5fcefbfda tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1574 microversion: 2.1 time: 0.253148 Apr 21 14:46:39.706736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 398/857] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:39 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1574 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:39.769346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1cefadb3-3df6-40d1-81b1-4f2b101eab00 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:39.771293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1cefadb3-3df6-40d1-81b1-4f2b101eab00 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:39.779195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-36470946-f267-4d90-8b4f-2ae81360c9ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 34784 microversion: 2.1 time: 0.158536 Apr 21 14:46:39.782226 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1cefadb3-3df6-40d1-81b1-4f2b101eab00 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:39.782381 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 460/858] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:39 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 34784 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:39.782484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1cefadb3-3df6-40d1-81b1-4f2b101eab00 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:39.782484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1cefadb3-3df6-40d1-81b1-4f2b101eab00 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:39.782484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1cefadb3-3df6-40d1-81b1-4f2b101eab00 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:39.907580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1cefadb3-3df6-40d1-81b1-4f2b101eab00 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.141726 Apr 21 14:46:39.912308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 399/859] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:39 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:39.938859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-425ac1dd-cf67-474f-857e-33d2b957933c req-2524cc21-db57-4964-8b9f-181f86f2f5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b1c253-7437-4a43-bc08-a0626125cd82", "tag": "cc544713-b84a-4e45-b04d-b437a6b4c09b"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:39.940837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:46:39.940837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:46:39.950582 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-425ac1dd-cf67-474f-857e-33d2b957933c req-2524cc21-db57-4964-8b9f-181f86f2f5b7 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:39.951082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-425ac1dd-cf67-474f-857e-33d2b957933c req-2524cc21-db57-4964-8b9f-181f86f2f5b7 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:39.969191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-425ac1dd-cf67-474f-857e-33d2b957933c req-2524cc21-db57-4964-8b9f-181f86f2f5b7 service nova] Creating event network-changed:cc544713-b84a-4e45-b04d-b437a6b4c09b for instance 77b1c253-7437-4a43-bc08-a0626125cd82 on hv-cinder-78638 Apr 21 14:46:39.975288 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-425ac1dd-cf67-474f-857e-33d2b957933c req-2524cc21-db57-4964-8b9f-181f86f2f5b7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193878 Apr 21 14:46:39.976305 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 461/860] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:46:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:46:40.725686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-35fd62ed-60ab-43a8-b3dc-1dd42815a017 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:40.727237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-35fd62ed-60ab-43a8-b3dc-1dd42815a017 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:40.737904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35fd62ed-60ab-43a8-b3dc-1dd42815a017 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:40.738734 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35fd62ed-60ab-43a8-b3dc-1dd42815a017 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:40.739925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35fd62ed-60ab-43a8-b3dc-1dd42815a017 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:40.740573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35fd62ed-60ab-43a8-b3dc-1dd42815a017 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:40.792867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-066be944-1658-426a-b6cd-3e1953cc8eda tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:40.794452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-066be944-1658-426a-b6cd-3e1953cc8eda tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:40.812054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-066be944-1658-426a-b6cd-3e1953cc8eda tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:40.814584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-066be944-1658-426a-b6cd-3e1953cc8eda tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:40.815680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-066be944-1658-426a-b6cd-3e1953cc8eda tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:40.816253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-066be944-1658-426a-b6cd-3e1953cc8eda tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:40.961259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-066be944-1658-426a-b6cd-3e1953cc8eda tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 35855 microversion: 2.1 time: 0.172769 Apr 21 14:46:40.962021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 462/861] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:40 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 35855 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:40.972080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5db40887-b25e-4eea-8086-f792b51e60e9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:40.973291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5db40887-b25e-4eea-8086-f792b51e60e9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:40.994164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5db40887-b25e-4eea-8086-f792b51e60e9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:40.994801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5db40887-b25e-4eea-8086-f792b51e60e9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:40.995833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5db40887-b25e-4eea-8086-f792b51e60e9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:40.996179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5db40887-b25e-4eea-8086-f792b51e60e9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:41.035831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-35fd62ed-60ab-43a8-b3dc-1dd42815a017 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:41.046335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-35fd62ed-60ab-43a8-b3dc-1dd42815a017 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1561 microversion: 2.1 time: 0.325776 Apr 21 14:46:41.047638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 400/862] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:40 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1561 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:41.133344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5db40887-b25e-4eea-8086-f792b51e60e9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.165364 Apr 21 14:46:41.133922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 463/863] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:40 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:41.974956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-29b0c870-2b57-4ed6-819d-dbbef9b6ee2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:41.976024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-29b0c870-2b57-4ed6-819d-dbbef9b6ee2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:41.985294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b0c870-2b57-4ed6-819d-dbbef9b6ee2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:41.985801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b0c870-2b57-4ed6-819d-dbbef9b6ee2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:41.986689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b0c870-2b57-4ed6-819d-dbbef9b6ee2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:41.987181 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b0c870-2b57-4ed6-819d-dbbef9b6ee2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:42.105208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-29b0c870-2b57-4ed6-819d-dbbef9b6ee2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 37445 microversion: 2.1 time: 0.134453 Apr 21 14:46:42.106039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 401/864] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:41 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 37445 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:42.146746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2da400ab-3b5e-49c4-b935-a409190c0d2d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:42.148025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2da400ab-3b5e-49c4-b935-a409190c0d2d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:42.157593 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2da400ab-3b5e-49c4-b935-a409190c0d2d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:42.158218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2da400ab-3b5e-49c4-b935-a409190c0d2d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:42.159139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2da400ab-3b5e-49c4-b935-a409190c0d2d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:42.159772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2da400ab-3b5e-49c4-b935-a409190c0d2d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:42.271701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2da400ab-3b5e-49c4-b935-a409190c0d2d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.129465 Apr 21 14:46:42.275209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 464/865] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:42 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:43.118413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-22e5ea9d-f03d-4c37-8321-55a45071b7f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:43.119564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-22e5ea9d-f03d-4c37-8321-55a45071b7f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:43.128471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22e5ea9d-f03d-4c37-8321-55a45071b7f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:43.128974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22e5ea9d-f03d-4c37-8321-55a45071b7f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:43.129921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22e5ea9d-f03d-4c37-8321-55a45071b7f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:43.130455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22e5ea9d-f03d-4c37-8321-55a45071b7f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:43.246824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-22e5ea9d-f03d-4c37-8321-55a45071b7f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 38269 microversion: 2.1 time: 0.132839 Apr 21 14:46:43.247547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 402/866] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:43 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 38269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:43.284935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-de00860d-d5af-467a-9790-1760161efbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:43.286267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-de00860d-d5af-467a-9790-1760161efbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:43.295350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de00860d-d5af-467a-9790-1760161efbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:43.295847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de00860d-d5af-467a-9790-1760161efbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:43.296664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de00860d-d5af-467a-9790-1760161efbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:43.297148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de00860d-d5af-467a-9790-1760161efbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:43.537934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-de00860d-d5af-467a-9790-1760161efbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.257536 Apr 21 14:46:43.538919 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 465/867] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:43 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:44.262486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f622cb15-2562-4c04-9834-9179104bd4d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:44.263739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f622cb15-2562-4c04-9834-9179104bd4d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:44.273205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f622cb15-2562-4c04-9834-9179104bd4d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:44.273690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f622cb15-2562-4c04-9834-9179104bd4d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:44.274654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f622cb15-2562-4c04-9834-9179104bd4d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:44.275112 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f622cb15-2562-4c04-9834-9179104bd4d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:44.378761 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f622cb15-2562-4c04-9834-9179104bd4d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 38269 microversion: 2.1 time: 0.120745 Apr 21 14:46:44.379483 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 403/868] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:44 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 38269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:44.551815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-70fe133b-1223-45ca-940a-4d56b904766e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:44.552884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-70fe133b-1223-45ca-940a-4d56b904766e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:44.561903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70fe133b-1223-45ca-940a-4d56b904766e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:44.562441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70fe133b-1223-45ca-940a-4d56b904766e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:44.563285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70fe133b-1223-45ca-940a-4d56b904766e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:44.563779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70fe133b-1223-45ca-940a-4d56b904766e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:44.661113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-70fe133b-1223-45ca-940a-4d56b904766e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.114336 Apr 21 14:46:44.661843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 466/869] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:44 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:45.394366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-947a517c-3d90-4ccb-ae8f-e721395624ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:45.395728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-947a517c-3d90-4ccb-ae8f-e721395624ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:45.408629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-947a517c-3d90-4ccb-ae8f-e721395624ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:45.409130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-947a517c-3d90-4ccb-ae8f-e721395624ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:45.410284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-947a517c-3d90-4ccb-ae8f-e721395624ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:45.411290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-947a517c-3d90-4ccb-ae8f-e721395624ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:45.527914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-947a517c-3d90-4ccb-ae8f-e721395624ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 38269 microversion: 2.1 time: 0.139511 Apr 21 14:46:45.529070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 404/870] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:45 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 38269 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:45.673579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d2212f35-beb5-4365-b547-5a1252cef589 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:45.674800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d2212f35-beb5-4365-b547-5a1252cef589 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:45.684784 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2212f35-beb5-4365-b547-5a1252cef589 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:45.685250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2212f35-beb5-4365-b547-5a1252cef589 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:45.686159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2212f35-beb5-4365-b547-5a1252cef589 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:45.686654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2212f35-beb5-4365-b547-5a1252cef589 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:45.795633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d2212f35-beb5-4365-b547-5a1252cef589 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.126697 Apr 21 14:46:45.796370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 467/871] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:45 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:46.541135 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fd5415f1-210b-4b65-9a8d-5999e3ca37f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:46.542369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fd5415f1-210b-4b65-9a8d-5999e3ca37f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:46.551939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd5415f1-210b-4b65-9a8d-5999e3ca37f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:46.552438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd5415f1-210b-4b65-9a8d-5999e3ca37f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:46.553278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd5415f1-210b-4b65-9a8d-5999e3ca37f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:46.553775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd5415f1-210b-4b65-9a8d-5999e3ca37f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:46.655133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fd5415f1-210b-4b65-9a8d-5999e3ca37f2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 38269 microversion: 2.1 time: 0.118449 Apr 21 14:46:46.655851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 405/872] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:46 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 38269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:46.812326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-30d19156-340e-4cdf-b562-288f0cc7de3b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:46.813821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-30d19156-340e-4cdf-b562-288f0cc7de3b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:46.825948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30d19156-340e-4cdf-b562-288f0cc7de3b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:46.826702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30d19156-340e-4cdf-b562-288f0cc7de3b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:46.827860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30d19156-340e-4cdf-b562-288f0cc7de3b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:46.828510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30d19156-340e-4cdf-b562-288f0cc7de3b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:46.928092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-30d19156-340e-4cdf-b562-288f0cc7de3b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.122315 Apr 21 14:46:46.928764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 468/873] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:46 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:47.670473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a1449bb9-34cc-4cfe-8294-2546bd499f47 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:47.671620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a1449bb9-34cc-4cfe-8294-2546bd499f47 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:47.681164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1449bb9-34cc-4cfe-8294-2546bd499f47 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:47.681679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1449bb9-34cc-4cfe-8294-2546bd499f47 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:47.682557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1449bb9-34cc-4cfe-8294-2546bd499f47 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:47.683045 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1449bb9-34cc-4cfe-8294-2546bd499f47 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:47.795728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a1449bb9-34cc-4cfe-8294-2546bd499f47 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 200 len: 38400 microversion: 2.1 time: 0.129917 Apr 21 14:46:47.796842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 406/874] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:47 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 38400 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:46:47.815571 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0ce2b997-9437-4aac-ab0e-c0e699e8cd81 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:47.816646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0ce2b997-9437-4aac-ab0e-c0e699e8cd81 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:47.826107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ce2b997-9437-4aac-ab0e-c0e699e8cd81 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:47.826610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ce2b997-9437-4aac-ab0e-c0e699e8cd81 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:47.827454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ce2b997-9437-4aac-ab0e-c0e699e8cd81 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:47.827949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ce2b997-9437-4aac-ab0e-c0e699e8cd81 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:47.889534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0ce2b997-9437-4aac-ab0e-c0e699e8cd81 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/ips" status: 200 len: 146 microversion: 2.1 time: 0.081992 Apr 21 14:46:47.890186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 469/875] 10.222.0.24 () {58 vars in 1238 bytes} [Wed Apr 21 14:46:47 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/ips => generated 146 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:46:47.942259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8a9b9024-46f8-48f2-b7df-da0e8ea8cf02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:47.943365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8a9b9024-46f8-48f2-b7df-da0e8ea8cf02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:47.952182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a9b9024-46f8-48f2-b7df-da0e8ea8cf02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:47.952684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a9b9024-46f8-48f2-b7df-da0e8ea8cf02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:47.953508 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a9b9024-46f8-48f2-b7df-da0e8ea8cf02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:47.954024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a9b9024-46f8-48f2-b7df-da0e8ea8cf02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:48.052820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8a9b9024-46f8-48f2-b7df-da0e8ea8cf02 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.115085 Apr 21 14:46:48.053528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 407/876] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:47 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:49.066720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c1343ec4-39a0-4f53-8700-6deb213ed857 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:49.067799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c1343ec4-39a0-4f53-8700-6deb213ed857 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:49.076352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1343ec4-39a0-4f53-8700-6deb213ed857 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:49.076801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1343ec4-39a0-4f53-8700-6deb213ed857 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:49.077632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1343ec4-39a0-4f53-8700-6deb213ed857 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:49.078196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1343ec4-39a0-4f53-8700-6deb213ed857 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:49.181830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c1343ec4-39a0-4f53-8700-6deb213ed857 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.119029 Apr 21 14:46:49.182714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 470/877] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:49 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:50.196127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4cd6b69d-c413-4a89-99d6-751486006f91 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:50.197503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4cd6b69d-c413-4a89-99d6-751486006f91 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:50.208060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cd6b69d-c413-4a89-99d6-751486006f91 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:50.208667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cd6b69d-c413-4a89-99d6-751486006f91 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:50.209744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cd6b69d-c413-4a89-99d6-751486006f91 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:50.210273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cd6b69d-c413-4a89-99d6-751486006f91 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:50.310150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4cd6b69d-c413-4a89-99d6-751486006f91 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 14 microversion: 2.20 time: 0.119264 Apr 21 14:46:50.310786 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 408/878] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:50 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:50.373638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-322aa737-4dcb-41bd-9610-19c23f20d8a1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "667020d6-b6f5-4d5c-9f50-5df7b3422832"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:50.375866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-322aa737-4dcb-41bd-9610-19c23f20d8a1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:50.389723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322aa737-4dcb-41bd-9610-19c23f20d8a1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:50.390579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322aa737-4dcb-41bd-9610-19c23f20d8a1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:50.391947 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322aa737-4dcb-41bd-9610-19c23f20d8a1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:50.392919 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322aa737-4dcb-41bd-9610-19c23f20d8a1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:50.817471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-322aa737-4dcb-41bd-9610-19c23f20d8a1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451794 Apr 21 14:46:50.818163 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 471/879] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:46:50 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:46:51.323081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9b5916db-47c1-4910-b4a4-f6dec652bbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:51.325468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9b5916db-47c1-4910-b4a4-f6dec652bbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:51.333289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b5916db-47c1-4910-b4a4-f6dec652bbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:51.333814 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b5916db-47c1-4910-b4a4-f6dec652bbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:51.334730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b5916db-47c1-4910-b4a4-f6dec652bbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:51.335226 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b5916db-47c1-4910-b4a4-f6dec652bbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:51.456801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9b5916db-47c1-4910-b4a4-f6dec652bbeb tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 9847 microversion: 2.20 time: 0.138402 Apr 21 14:46:51.457516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 409/880] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:51 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 9847 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:46:52.474232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9787ff71-9a62-490d-b618-524315a116ba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:52.475529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9787ff71-9a62-490d-b618-524315a116ba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:52.489436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9787ff71-9a62-490d-b618-524315a116ba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:52.490327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9787ff71-9a62-490d-b618-524315a116ba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:52.491333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9787ff71-9a62-490d-b618-524315a116ba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:52.491830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9787ff71-9a62-490d-b618-524315a116ba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:52.590861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9787ff71-9a62-490d-b618-524315a116ba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 16364 microversion: 2.20 time: 0.124474 Apr 21 14:46:52.591606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 472/881] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:52 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 16364 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:46:53.608188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-20d54832-393c-402b-9ecd-4cc150ed05cf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:53.609430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-20d54832-393c-402b-9ecd-4cc150ed05cf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:53.619947 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20d54832-393c-402b-9ecd-4cc150ed05cf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:53.620539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20d54832-393c-402b-9ecd-4cc150ed05cf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:53.621507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20d54832-393c-402b-9ecd-4cc150ed05cf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:53.622113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20d54832-393c-402b-9ecd-4cc150ed05cf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:53.741201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-20d54832-393c-402b-9ecd-4cc150ed05cf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 18305 microversion: 2.20 time: 0.138581 Apr 21 14:46:53.741923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 410/882] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:53 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 18305 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:46:54.754402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1d96479e-3b83-47e4-a6b5-d3fea8836a8a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:54.755538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1d96479e-3b83-47e4-a6b5-d3fea8836a8a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:54.764677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d96479e-3b83-47e4-a6b5-d3fea8836a8a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:54.765182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d96479e-3b83-47e4-a6b5-d3fea8836a8a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:54.766027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d96479e-3b83-47e4-a6b5-d3fea8836a8a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:54.766548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d96479e-3b83-47e4-a6b5-d3fea8836a8a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:54.874783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1d96479e-3b83-47e4-a6b5-d3fea8836a8a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 20148 microversion: 2.20 time: 0.124854 Apr 21 14:46:54.875492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 473/883] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:54 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 20148 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:46:55.889363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c6ccefd2-4290-4652-bb6b-24c3bf545bb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:55.890538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c6ccefd2-4290-4652-bb6b-24c3bf545bb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:55.901470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6ccefd2-4290-4652-bb6b-24c3bf545bb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:55.901470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6ccefd2-4290-4652-bb6b-24c3bf545bb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:55.901470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6ccefd2-4290-4652-bb6b-24c3bf545bb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:55.901470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6ccefd2-4290-4652-bb6b-24c3bf545bb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:56.004974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c6ccefd2-4290-4652-bb6b-24c3bf545bb0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 22716 microversion: 2.20 time: 0.120056 Apr 21 14:46:56.005729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 411/884] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:55 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 22716 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:46:57.018876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b9ac8e7-875a-4d7e-be1a-fef90208bfcc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:57.020012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b9ac8e7-875a-4d7e-be1a-fef90208bfcc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:57.029104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b9ac8e7-875a-4d7e-be1a-fef90208bfcc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:57.029605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b9ac8e7-875a-4d7e-be1a-fef90208bfcc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:57.030469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b9ac8e7-875a-4d7e-be1a-fef90208bfcc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:57.030956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b9ac8e7-875a-4d7e-be1a-fef90208bfcc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:57.155094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b9ac8e7-875a-4d7e-be1a-fef90208bfcc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 23804 microversion: 2.20 time: 0.140822 Apr 21 14:46:57.156049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 474/885] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:57 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 23804 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:46:58.173134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4135c652-3617-44c5-abd1-fb9f43df3fd4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:58.174723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4135c652-3617-44c5-abd1-fb9f43df3fd4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:58.186082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4135c652-3617-44c5-abd1-fb9f43df3fd4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:58.186612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4135c652-3617-44c5-abd1-fb9f43df3fd4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:58.187457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4135c652-3617-44c5-abd1-fb9f43df3fd4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:58.187951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4135c652-3617-44c5-abd1-fb9f43df3fd4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:58.298096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4135c652-3617-44c5-abd1-fb9f43df3fd4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 25213 microversion: 2.20 time: 0.131961 Apr 21 14:46:58.298764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 412/886] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:58 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 25213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:46:58.741721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c746ca2e-f876-420e-bf84-9c0c39e6cc71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:58.754918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c746ca2e-f876-420e-bf84-9c0c39e6cc71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:58.755591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c746ca2e-f876-420e-bf84-9c0c39e6cc71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:58.817937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c746ca2e-f876-420e-bf84-9c0c39e6cc71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Going to try to stop instance {{(pid=100564) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 21 14:46:58.900718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c746ca2e-f876-420e-bf84-9c0c39e6cc71 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 202 len: 0 microversion: 2.1 time: 0.166716 Apr 21 14:46:58.901404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 475/887] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:46:58 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:46:58.912166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2800b49f-7f62-4686-b979-f259d54aba51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:46:58.912937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2800b49f-7f62-4686-b979-f259d54aba51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:58.923952 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2800b49f-7f62-4686-b979-f259d54aba51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:58.924599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2800b49f-7f62-4686-b979-f259d54aba51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:58.926163 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2800b49f-7f62-4686-b979-f259d54aba51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:58.926854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2800b49f-7f62-4686-b979-f259d54aba51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:59.152101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2800b49f-7f62-4686-b979-f259d54aba51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:46:59.162481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2800b49f-7f62-4686-b979-f259d54aba51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.254959 Apr 21 14:46:59.163111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 413/888] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:46:58 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:46:59.311698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cec18300-d7f6-418c-8653-c0170209425d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:46:59.312889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cec18300-d7f6-418c-8653-c0170209425d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:46:59.321793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cec18300-d7f6-418c-8653-c0170209425d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:59.322353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cec18300-d7f6-418c-8653-c0170209425d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:59.323185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cec18300-d7f6-418c-8653-c0170209425d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:46:59.323670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cec18300-d7f6-418c-8653-c0170209425d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:46:59.430871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cec18300-d7f6-418c-8653-c0170209425d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 26588 microversion: 2.20 time: 0.123175 Apr 21 14:46:59.431954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 476/889] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:46:59 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 26588 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:00.182388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e46bc834-0822-416a-8424-08eb4302f0f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:00.183042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e46bc834-0822-416a-8424-08eb4302f0f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:00.191964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e46bc834-0822-416a-8424-08eb4302f0f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:00.192470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e46bc834-0822-416a-8424-08eb4302f0f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:00.193306 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e46bc834-0822-416a-8424-08eb4302f0f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:00.193793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e46bc834-0822-416a-8424-08eb4302f0f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:00.427126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e46bc834-0822-416a-8424-08eb4302f0f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:00.437192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e46bc834-0822-416a-8424-08eb4302f0f1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.259127 Apr 21 14:47:00.437825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 414/890] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:00 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:00.446162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-54e213b3-1d73-4089-bb69-028b673a757a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:00.447371 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-54e213b3-1d73-4089-bb69-028b673a757a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:00.456425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54e213b3-1d73-4089-bb69-028b673a757a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:00.456929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54e213b3-1d73-4089-bb69-028b673a757a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:00.457765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54e213b3-1d73-4089-bb69-028b673a757a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:00.458282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54e213b3-1d73-4089-bb69-028b673a757a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:00.562256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-54e213b3-1d73-4089-bb69-028b673a757a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 27337 microversion: 2.20 time: 0.120488 Apr 21 14:47:00.562979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 477/891] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:00 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 27337 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:01.456495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8cbe35f4-b993-48aa-8bda-a02d217e8557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:01.457131 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8cbe35f4-b993-48aa-8bda-a02d217e8557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:01.466145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8cbe35f4-b993-48aa-8bda-a02d217e8557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:01.466673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8cbe35f4-b993-48aa-8bda-a02d217e8557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:01.467525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8cbe35f4-b993-48aa-8bda-a02d217e8557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:01.468023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8cbe35f4-b993-48aa-8bda-a02d217e8557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:01.576728 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3fcbc006-aa1e-406a-b564-be3cea9b6a50 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:01.577923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3fcbc006-aa1e-406a-b564-be3cea9b6a50 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:01.587699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fcbc006-aa1e-406a-b564-be3cea9b6a50 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:01.588210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fcbc006-aa1e-406a-b564-be3cea9b6a50 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:01.589076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fcbc006-aa1e-406a-b564-be3cea9b6a50 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:01.589580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fcbc006-aa1e-406a-b564-be3cea9b6a50 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:01.707252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3fcbc006-aa1e-406a-b564-be3cea9b6a50 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 27692 microversion: 2.20 time: 0.135454 Apr 21 14:47:01.707851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 478/892] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:01 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 27692 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:01.709956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8cbe35f4-b993-48aa-8bda-a02d217e8557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:01.720503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8cbe35f4-b993-48aa-8bda-a02d217e8557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.268128 Apr 21 14:47:01.721164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 415/893] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:01 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:02.721280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-04cf49c4-bb83-480d-916a-8eb9f1ca6802 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:02.722489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-04cf49c4-bb83-480d-916a-8eb9f1ca6802 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:02.732791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-04cf49c4-bb83-480d-916a-8eb9f1ca6802 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:02.733503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-04cf49c4-bb83-480d-916a-8eb9f1ca6802 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:02.734563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-04cf49c4-bb83-480d-916a-8eb9f1ca6802 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:02.735082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-04cf49c4-bb83-480d-916a-8eb9f1ca6802 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:02.742387 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6a02084f-9fe3-4c4f-8c09-b6249c9ff91c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:02.742992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6a02084f-9fe3-4c4f-8c09-b6249c9ff91c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:02.752115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a02084f-9fe3-4c4f-8c09-b6249c9ff91c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:02.752604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a02084f-9fe3-4c4f-8c09-b6249c9ff91c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:02.753484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a02084f-9fe3-4c4f-8c09-b6249c9ff91c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:02.754021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a02084f-9fe3-4c4f-8c09-b6249c9ff91c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:02.854145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-04cf49c4-bb83-480d-916a-8eb9f1ca6802 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28064 microversion: 2.20 time: 0.137312 Apr 21 14:47:02.854891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 479/894] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:02 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28064 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:02.980233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6a02084f-9fe3-4c4f-8c09-b6249c9ff91c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:02.990207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6a02084f-9fe3-4c4f-8c09-b6249c9ff91c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.253500 Apr 21 14:47:02.990813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 416/895] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:02 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:47:03.868369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d4065451-86bf-40af-b836-8568a3ce7931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:03.869519 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d4065451-86bf-40af-b836-8568a3ce7931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:03.878644 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4065451-86bf-40af-b836-8568a3ce7931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:03.879203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4065451-86bf-40af-b836-8568a3ce7931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:03.880051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4065451-86bf-40af-b836-8568a3ce7931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:03.880542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4065451-86bf-40af-b836-8568a3ce7931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:03.982029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d4065451-86bf-40af-b836-8568a3ce7931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.118207 Apr 21 14:47:03.982791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 480/896] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:03 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:04.009351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c8290879-1c9b-44a5-8675-b628be3cdcb2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:04.010217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c8290879-1c9b-44a5-8675-b628be3cdcb2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:04.018940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8290879-1c9b-44a5-8675-b628be3cdcb2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:04.019468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8290879-1c9b-44a5-8675-b628be3cdcb2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:04.020364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8290879-1c9b-44a5-8675-b628be3cdcb2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:04.020857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8290879-1c9b-44a5-8675-b628be3cdcb2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:04.253461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c8290879-1c9b-44a5-8675-b628be3cdcb2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:04.267840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c8290879-1c9b-44a5-8675-b628be3cdcb2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.262347 Apr 21 14:47:04.268759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 417/897] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:04 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:04.995781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0f31a192-39c3-4d0d-bc0b-5c3332524c3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:04.996927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0f31a192-39c3-4d0d-bc0b-5c3332524c3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:05.006036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f31a192-39c3-4d0d-bc0b-5c3332524c3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:05.006584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f31a192-39c3-4d0d-bc0b-5c3332524c3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:05.007434 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f31a192-39c3-4d0d-bc0b-5c3332524c3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:05.007936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f31a192-39c3-4d0d-bc0b-5c3332524c3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:05.121021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0f31a192-39c3-4d0d-bc0b-5c3332524c3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.129734 Apr 21 14:47:05.122189 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 481/898] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:04 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:05.287543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7c688b0b-c75b-4a2a-879d-9b9efd808669 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:05.288147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7c688b0b-c75b-4a2a-879d-9b9efd808669 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:05.296770 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c688b0b-c75b-4a2a-879d-9b9efd808669 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:05.297283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c688b0b-c75b-4a2a-879d-9b9efd808669 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:05.298160 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c688b0b-c75b-4a2a-879d-9b9efd808669 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:05.298658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c688b0b-c75b-4a2a-879d-9b9efd808669 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:05.520309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7c688b0b-c75b-4a2a-879d-9b9efd808669 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:05.530780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7c688b0b-c75b-4a2a-879d-9b9efd808669 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.247366 Apr 21 14:47:05.531491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 418/899] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:05 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:06.136042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d9e92809-6c1e-4043-a782-595ae6fb1f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:06.137224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d9e92809-6c1e-4043-a782-595ae6fb1f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:06.146502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9e92809-6c1e-4043-a782-595ae6fb1f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:06.147012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9e92809-6c1e-4043-a782-595ae6fb1f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:06.147866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9e92809-6c1e-4043-a782-595ae6fb1f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:06.148357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9e92809-6c1e-4043-a782-595ae6fb1f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:06.252931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d9e92809-6c1e-4043-a782-595ae6fb1f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.121697 Apr 21 14:47:06.253667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 482/900] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:06 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:06.551020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-36f9ec4e-e2c0-49ba-a4af-b27d0763ffc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:06.551704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-36f9ec4e-e2c0-49ba-a4af-b27d0763ffc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:06.561365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36f9ec4e-e2c0-49ba-a4af-b27d0763ffc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:06.561882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36f9ec4e-e2c0-49ba-a4af-b27d0763ffc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:06.562784 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36f9ec4e-e2c0-49ba-a4af-b27d0763ffc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:06.563287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36f9ec4e-e2c0-49ba-a4af-b27d0763ffc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:06.784882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-36f9ec4e-e2c0-49ba-a4af-b27d0763ffc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:06.795370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-36f9ec4e-e2c0-49ba-a4af-b27d0763ffc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.249292 Apr 21 14:47:06.796019 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 419/901] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:06 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:07.267469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6bd31e96-ca51-48ba-99b3-5f0a24da0d81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:07.268608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6bd31e96-ca51-48ba-99b3-5f0a24da0d81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:07.277953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bd31e96-ca51-48ba-99b3-5f0a24da0d81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:07.278513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bd31e96-ca51-48ba-99b3-5f0a24da0d81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:07.279350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bd31e96-ca51-48ba-99b3-5f0a24da0d81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:07.279851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6bd31e96-ca51-48ba-99b3-5f0a24da0d81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:07.387832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6bd31e96-ca51-48ba-99b3-5f0a24da0d81 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.125230 Apr 21 14:47:07.388532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 483/902] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:07 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:07.814701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-95c337f6-7e75-47ac-a3bf-2e0a4a2fcf82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:07.815392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-95c337f6-7e75-47ac-a3bf-2e0a4a2fcf82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:07.823843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-95c337f6-7e75-47ac-a3bf-2e0a4a2fcf82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:07.824343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-95c337f6-7e75-47ac-a3bf-2e0a4a2fcf82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:07.825202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-95c337f6-7e75-47ac-a3bf-2e0a4a2fcf82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:07.825675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-95c337f6-7e75-47ac-a3bf-2e0a4a2fcf82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:08.083930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-95c337f6-7e75-47ac-a3bf-2e0a4a2fcf82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:08.094739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-95c337f6-7e75-47ac-a3bf-2e0a4a2fcf82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.284093 Apr 21 14:47:08.095467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 420/903] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:07 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:08.401955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bee46a6d-551f-4228-9cf3-becc7a4fd06c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:08.403344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bee46a6d-551f-4228-9cf3-becc7a4fd06c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:08.412932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bee46a6d-551f-4228-9cf3-becc7a4fd06c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:08.413442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bee46a6d-551f-4228-9cf3-becc7a4fd06c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:08.414320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bee46a6d-551f-4228-9cf3-becc7a4fd06c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:08.414816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bee46a6d-551f-4228-9cf3-becc7a4fd06c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:08.521495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bee46a6d-551f-4228-9cf3-becc7a4fd06c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.124332 Apr 21 14:47:08.522257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 484/904] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:08 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:09.113776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-279bd1cd-2615-459d-a135-3294ad54c17c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:09.114352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-279bd1cd-2615-459d-a135-3294ad54c17c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:09.122875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-279bd1cd-2615-459d-a135-3294ad54c17c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:09.123384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-279bd1cd-2615-459d-a135-3294ad54c17c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:09.124235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-279bd1cd-2615-459d-a135-3294ad54c17c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:09.124725 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-279bd1cd-2615-459d-a135-3294ad54c17c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:09.347218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-279bd1cd-2615-459d-a135-3294ad54c17c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:09.357262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-279bd1cd-2615-459d-a135-3294ad54c17c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.247621 Apr 21 14:47:09.357922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 421/905] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:09 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:09.535310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-40bc5e2b-4f0e-4d59-b4c0-61eabc4e053e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:09.536471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-40bc5e2b-4f0e-4d59-b4c0-61eabc4e053e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:09.545759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40bc5e2b-4f0e-4d59-b4c0-61eabc4e053e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:09.546367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40bc5e2b-4f0e-4d59-b4c0-61eabc4e053e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:09.547273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40bc5e2b-4f0e-4d59-b4c0-61eabc4e053e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:09.547825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-40bc5e2b-4f0e-4d59-b4c0-61eabc4e053e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:09.665557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-40bc5e2b-4f0e-4d59-b4c0-61eabc4e053e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.134640 Apr 21 14:47:09.666326 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 485/906] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:09 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:10.377387 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7ad15e68-ee2c-4813-99b7-52663b526c24 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:10.377979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7ad15e68-ee2c-4813-99b7-52663b526c24 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:10.386838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ad15e68-ee2c-4813-99b7-52663b526c24 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:10.387354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ad15e68-ee2c-4813-99b7-52663b526c24 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:10.388202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ad15e68-ee2c-4813-99b7-52663b526c24 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:10.388665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ad15e68-ee2c-4813-99b7-52663b526c24 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:10.616818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7ad15e68-ee2c-4813-99b7-52663b526c24 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:10.627022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7ad15e68-ee2c-4813-99b7-52663b526c24 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.253953 Apr 21 14:47:10.627750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 422/907] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:10 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:10.678775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9121ea27-bdfd-45a5-b329-2121e44078fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:10.679924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9121ea27-bdfd-45a5-b329-2121e44078fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:10.689117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9121ea27-bdfd-45a5-b329-2121e44078fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:10.689625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9121ea27-bdfd-45a5-b329-2121e44078fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:10.690504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9121ea27-bdfd-45a5-b329-2121e44078fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:10.690993 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9121ea27-bdfd-45a5-b329-2121e44078fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:10.794739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9121ea27-bdfd-45a5-b329-2121e44078fd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.120829 Apr 21 14:47:10.795499 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 486/908] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:10 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:11.646368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-89120be6-1679-49ca-9601-384b0df0495d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:11.647096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-89120be6-1679-49ca-9601-384b0df0495d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:11.655976 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89120be6-1679-49ca-9601-384b0df0495d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:11.656497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89120be6-1679-49ca-9601-384b0df0495d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:11.657360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89120be6-1679-49ca-9601-384b0df0495d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:11.657856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89120be6-1679-49ca-9601-384b0df0495d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:11.809050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c7748e16-8f09-4873-9e53-647430a761c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:11.810243 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c7748e16-8f09-4873-9e53-647430a761c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:11.819392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7748e16-8f09-4873-9e53-647430a761c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:11.819880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7748e16-8f09-4873-9e53-647430a761c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:11.820758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7748e16-8f09-4873-9e53-647430a761c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:11.821253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7748e16-8f09-4873-9e53-647430a761c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:11.887053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-89120be6-1679-49ca-9601-384b0df0495d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:11.898650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-89120be6-1679-49ca-9601-384b0df0495d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.256054 Apr 21 14:47:11.899225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 423/909] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:11 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:11.928149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c7748e16-8f09-4873-9e53-647430a761c2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.123987 Apr 21 14:47:11.928915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 487/910] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:11 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:12.920939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fec30efc-5d6e-4cc7-97e5-66009ff0257e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:12.921588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fec30efc-5d6e-4cc7-97e5-66009ff0257e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:12.934027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fec30efc-5d6e-4cc7-97e5-66009ff0257e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:12.934551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fec30efc-5d6e-4cc7-97e5-66009ff0257e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:12.935368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fec30efc-5d6e-4cc7-97e5-66009ff0257e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:12.935861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fec30efc-5d6e-4cc7-97e5-66009ff0257e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:12.941886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-59d61256-1fc9-4130-a646-70495fc3fb6c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:12.943157 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-59d61256-1fc9-4130-a646-70495fc3fb6c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:12.952204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59d61256-1fc9-4130-a646-70495fc3fb6c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:12.952714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59d61256-1fc9-4130-a646-70495fc3fb6c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:12.953552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59d61256-1fc9-4130-a646-70495fc3fb6c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:12.954034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59d61256-1fc9-4130-a646-70495fc3fb6c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:13.057645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-59d61256-1fc9-4130-a646-70495fc3fb6c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.120085 Apr 21 14:47:13.058419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 488/911] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:12 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:13.159880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fec30efc-5d6e-4cc7-97e5-66009ff0257e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:13.176508 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fec30efc-5d6e-4cc7-97e5-66009ff0257e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.261740 Apr 21 14:47:13.177356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 424/912] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:12 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:14.076611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3f31f42-e4fe-4715-9971-4d9ab1574328 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:14.078727 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a3f31f42-e4fe-4715-9971-4d9ab1574328 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:14.095290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3f31f42-e4fe-4715-9971-4d9ab1574328 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:14.096177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3f31f42-e4fe-4715-9971-4d9ab1574328 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:14.097702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3f31f42-e4fe-4715-9971-4d9ab1574328 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:14.098647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3f31f42-e4fe-4715-9971-4d9ab1574328 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:14.199082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1fe0cce1-c376-4932-ab36-6ccc1f8e001c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:14.199754 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1fe0cce1-c376-4932-ab36-6ccc1f8e001c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:14.209155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fe0cce1-c376-4932-ab36-6ccc1f8e001c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:14.209673 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fe0cce1-c376-4932-ab36-6ccc1f8e001c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:14.210561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a3f31f42-e4fe-4715-9971-4d9ab1574328 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.143189 Apr 21 14:47:14.210709 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fe0cce1-c376-4932-ab36-6ccc1f8e001c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:14.211063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fe0cce1-c376-4932-ab36-6ccc1f8e001c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:14.211240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 489/913] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:14 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:14.439466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1fe0cce1-c376-4932-ab36-6ccc1f8e001c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:14.450930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1fe0cce1-c376-4932-ab36-6ccc1f8e001c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1724 microversion: 2.1 time: 0.256829 Apr 21 14:47:14.451586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 425/914] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:14 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:15.224343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ef6dc9da-4752-435e-915d-1d9b8739c2da tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:15.225487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ef6dc9da-4752-435e-915d-1d9b8739c2da tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:15.234777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef6dc9da-4752-435e-915d-1d9b8739c2da tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:15.235282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef6dc9da-4752-435e-915d-1d9b8739c2da tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:15.236125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef6dc9da-4752-435e-915d-1d9b8739c2da tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:15.236617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef6dc9da-4752-435e-915d-1d9b8739c2da tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:15.342149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ef6dc9da-4752-435e-915d-1d9b8739c2da tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.122094 Apr 21 14:47:15.342812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 490/915] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:15 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:15.469460 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fb142b3d-1aeb-4989-93e8-73b76424de1f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:15.470179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fb142b3d-1aeb-4989-93e8-73b76424de1f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:15.478987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb142b3d-1aeb-4989-93e8-73b76424de1f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:15.479525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb142b3d-1aeb-4989-93e8-73b76424de1f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:15.480350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb142b3d-1aeb-4989-93e8-73b76424de1f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:15.480841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb142b3d-1aeb-4989-93e8-73b76424de1f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:15.712877 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fb142b3d-1aeb-4989-93e8-73b76424de1f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:15.728222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fb142b3d-1aeb-4989-93e8-73b76424de1f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1701 microversion: 2.1 time: 0.262966 Apr 21 14:47:15.728849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 426/916] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:15 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1701 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:15.746862 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f2fa98f-c2a9-417f-8a97-fb6d09a34e46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:15.755702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f2fa98f-c2a9-417f-8a97-fb6d09a34e46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:15.756215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f2fa98f-c2a9-417f-8a97-fb6d09a34e46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:15.818350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f2fa98f-c2a9-417f-8a97-fb6d09a34e46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Going to try to start instance {{(pid=100564) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 21 14:47:15.902805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f2fa98f-c2a9-417f-8a97-fb6d09a34e46 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 202 len: 0 microversion: 2.1 time: 0.160321 Apr 21 14:47:15.903735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 491/917] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:47:15 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:15.914996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-58c99dff-81c4-4e44-8391-22030f56f443 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:15.915674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-58c99dff-81c4-4e44-8391-22030f56f443 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:15.923779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c99dff-81c4-4e44-8391-22030f56f443 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:15.924289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c99dff-81c4-4e44-8391-22030f56f443 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:15.925520 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c99dff-81c4-4e44-8391-22030f56f443 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:15.926037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c99dff-81c4-4e44-8391-22030f56f443 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:16.156669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-58c99dff-81c4-4e44-8391-22030f56f443 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:16.169410 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-58c99dff-81c4-4e44-8391-22030f56f443 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1710 microversion: 2.1 time: 0.260745 Apr 21 14:47:16.170050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 427/918] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:15 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1710 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:16.356150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d819f937-ad0f-45f2-80ed-8573bfb212b1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:16.357638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d819f937-ad0f-45f2-80ed-8573bfb212b1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:16.366463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d819f937-ad0f-45f2-80ed-8573bfb212b1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:16.366978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d819f937-ad0f-45f2-80ed-8573bfb212b1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:16.367830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d819f937-ad0f-45f2-80ed-8573bfb212b1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:16.368422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d819f937-ad0f-45f2-80ed-8573bfb212b1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:16.475449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d819f937-ad0f-45f2-80ed-8573bfb212b1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.123585 Apr 21 14:47:16.476059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 492/919] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:16 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:17.190587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-342c70d5-11e0-452c-b27d-95f39207c797 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:17.191350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-342c70d5-11e0-452c-b27d-95f39207c797 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:17.199882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-342c70d5-11e0-452c-b27d-95f39207c797 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:17.200397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-342c70d5-11e0-452c-b27d-95f39207c797 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:17.201249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-342c70d5-11e0-452c-b27d-95f39207c797 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:17.201748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-342c70d5-11e0-452c-b27d-95f39207c797 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:17.425835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-342c70d5-11e0-452c-b27d-95f39207c797 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:17.435506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-342c70d5-11e0-452c-b27d-95f39207c797 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1710 microversion: 2.1 time: 0.249178 Apr 21 14:47:17.436125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 428/920] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:17 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1710 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:17.491735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dabf1c01-ddd0-49a5-8721-04d74de4075b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:17.493176 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dabf1c01-ddd0-49a5-8721-04d74de4075b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:17.505328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dabf1c01-ddd0-49a5-8721-04d74de4075b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:17.505927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dabf1c01-ddd0-49a5-8721-04d74de4075b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:17.506992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dabf1c01-ddd0-49a5-8721-04d74de4075b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:17.507610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dabf1c01-ddd0-49a5-8721-04d74de4075b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:17.613033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dabf1c01-ddd0-49a5-8721-04d74de4075b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28181 microversion: 2.20 time: 0.127528 Apr 21 14:47:17.613861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 493/921] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:17 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28181 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:18.455134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-37efdb17-5b90-4660-b607-6f6320a660ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:47:18.455834 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-37efdb17-5b90-4660-b607-6f6320a660ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:18.464489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37efdb17-5b90-4660-b607-6f6320a660ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:18.465025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37efdb17-5b90-4660-b607-6f6320a660ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:18.465884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37efdb17-5b90-4660-b607-6f6320a660ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:18.466405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37efdb17-5b90-4660-b607-6f6320a660ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:18.626657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c51650a-56b7-49f5-aec4-c1699f991824 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:18.627803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9c51650a-56b7-49f5-aec4-c1699f991824 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:18.637859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c51650a-56b7-49f5-aec4-c1699f991824 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:18.638399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c51650a-56b7-49f5-aec4-c1699f991824 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:18.639251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c51650a-56b7-49f5-aec4-c1699f991824 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:18.639743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c51650a-56b7-49f5-aec4-c1699f991824 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:18.708109 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-37efdb17-5b90-4660-b607-6f6320a660ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:47:18.717961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-37efdb17-5b90-4660-b607-6f6320a660ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1714 microversion: 2.1 time: 0.267078 Apr 21 14:47:18.718621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 429/922] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:47:18 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1714 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:47:18.767879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c51650a-56b7-49f5-aec4-c1699f991824 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28470 microversion: 2.20 time: 0.145731 Apr 21 14:47:18.768605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 494/923] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:18 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:19.781119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3d9a823b-3a4f-465a-a7ed-51a9fac25d63 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:19.782317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3d9a823b-3a4f-465a-a7ed-51a9fac25d63 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:19.790818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3d9a823b-3a4f-465a-a7ed-51a9fac25d63 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:19.791327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3d9a823b-3a4f-465a-a7ed-51a9fac25d63 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:19.792191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3d9a823b-3a4f-465a-a7ed-51a9fac25d63 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:19.792671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3d9a823b-3a4f-465a-a7ed-51a9fac25d63 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:19.898523 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3d9a823b-3a4f-465a-a7ed-51a9fac25d63 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28470 microversion: 2.20 time: 0.121333 Apr 21 14:47:19.899275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 430/924] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:19 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28470 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:20.912998 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bbb0807d-3f20-4e63-8485-e1d2e054cbc4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:20.914235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bbb0807d-3f20-4e63-8485-e1d2e054cbc4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:20.923541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbb0807d-3f20-4e63-8485-e1d2e054cbc4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:20.924044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbb0807d-3f20-4e63-8485-e1d2e054cbc4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:20.925187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbb0807d-3f20-4e63-8485-e1d2e054cbc4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:20.925680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbb0807d-3f20-4e63-8485-e1d2e054cbc4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:21.047257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bbb0807d-3f20-4e63-8485-e1d2e054cbc4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.139121 Apr 21 14:47:21.048079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 495/925] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:20 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:22.061595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e33f859f-88be-44ff-ad99-42fb21597ea3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:22.062777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e33f859f-88be-44ff-ad99-42fb21597ea3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:22.071771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e33f859f-88be-44ff-ad99-42fb21597ea3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:22.072277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e33f859f-88be-44ff-ad99-42fb21597ea3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:22.073121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e33f859f-88be-44ff-ad99-42fb21597ea3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:22.073603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e33f859f-88be-44ff-ad99-42fb21597ea3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:22.172446 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e33f859f-88be-44ff-ad99-42fb21597ea3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.115319 Apr 21 14:47:22.173180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 431/926] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:22 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:23.192985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5b7242dc-fcad-4833-8ebb-1d51f4b42b68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:23.194856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5b7242dc-fcad-4833-8ebb-1d51f4b42b68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:23.205113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b7242dc-fcad-4833-8ebb-1d51f4b42b68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:23.205629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b7242dc-fcad-4833-8ebb-1d51f4b42b68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:23.206501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b7242dc-fcad-4833-8ebb-1d51f4b42b68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:23.206960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b7242dc-fcad-4833-8ebb-1d51f4b42b68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:23.310943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5b7242dc-fcad-4833-8ebb-1d51f4b42b68 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.124817 Apr 21 14:47:23.311669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 496/927] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:23 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:24.331676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-06d9aea5-646d-428b-be35-e25fd6c3e7ff tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:24.333386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-06d9aea5-646d-428b-be35-e25fd6c3e7ff tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:24.343572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06d9aea5-646d-428b-be35-e25fd6c3e7ff tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:24.344042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06d9aea5-646d-428b-be35-e25fd6c3e7ff tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:24.344897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06d9aea5-646d-428b-be35-e25fd6c3e7ff tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:24.345382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06d9aea5-646d-428b-be35-e25fd6c3e7ff tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:24.457000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-06d9aea5-646d-428b-be35-e25fd6c3e7ff tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.133084 Apr 21 14:47:24.457706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 432/928] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:24 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:25.472965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ffa15107-db25-4054-b452-44f809462bbd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:25.474147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ffa15107-db25-4054-b452-44f809462bbd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:25.483763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffa15107-db25-4054-b452-44f809462bbd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:25.484270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffa15107-db25-4054-b452-44f809462bbd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:25.485116 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffa15107-db25-4054-b452-44f809462bbd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:25.485610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffa15107-db25-4054-b452-44f809462bbd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:25.595190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ffa15107-db25-4054-b452-44f809462bbd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.126185 Apr 21 14:47:25.596021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 497/929] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:25 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:26.613607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dfb4f591-ff04-4fe8-b38e-d756044a1eba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:26.614925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dfb4f591-ff04-4fe8-b38e-d756044a1eba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:26.625253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfb4f591-ff04-4fe8-b38e-d756044a1eba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:26.625764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfb4f591-ff04-4fe8-b38e-d756044a1eba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:26.626638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfb4f591-ff04-4fe8-b38e-d756044a1eba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:26.627131 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfb4f591-ff04-4fe8-b38e-d756044a1eba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:26.730676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dfb4f591-ff04-4fe8-b38e-d756044a1eba tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.124296 Apr 21 14:47:26.731425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 433/930] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:26 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:27.745299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bae2715d-7bea-4416-a31a-81d56f7e83f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:27.746475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bae2715d-7bea-4416-a31a-81d56f7e83f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:27.755589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bae2715d-7bea-4416-a31a-81d56f7e83f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:27.756090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bae2715d-7bea-4416-a31a-81d56f7e83f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:27.756917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bae2715d-7bea-4416-a31a-81d56f7e83f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:27.757402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bae2715d-7bea-4416-a31a-81d56f7e83f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:27.864077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bae2715d-7bea-4416-a31a-81d56f7e83f0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.122781 Apr 21 14:47:27.864980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 498/931] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:27 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:28.883040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-831b9c8d-d42f-4c0c-bd3d-b9f1a3a426ab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:28.884558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-831b9c8d-d42f-4c0c-bd3d-b9f1a3a426ab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:28.897554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-831b9c8d-d42f-4c0c-bd3d-b9f1a3a426ab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:28.898338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-831b9c8d-d42f-4c0c-bd3d-b9f1a3a426ab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:28.899480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-831b9c8d-d42f-4c0c-bd3d-b9f1a3a426ab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:28.900224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-831b9c8d-d42f-4c0c-bd3d-b9f1a3a426ab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:29.012829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-831b9c8d-d42f-4c0c-bd3d-b9f1a3a426ab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.136436 Apr 21 14:47:29.013782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 434/932] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:28 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:30.027465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-362c2405-0312-43cc-ba84-8b6d2ff35708 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:30.029319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-362c2405-0312-43cc-ba84-8b6d2ff35708 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:30.042962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-362c2405-0312-43cc-ba84-8b6d2ff35708 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:30.043474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-362c2405-0312-43cc-ba84-8b6d2ff35708 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:30.044342 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-362c2405-0312-43cc-ba84-8b6d2ff35708 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:30.044833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-362c2405-0312-43cc-ba84-8b6d2ff35708 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:30.150328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-362c2405-0312-43cc-ba84-8b6d2ff35708 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.127826 Apr 21 14:47:30.151025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 499/933] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:30 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:31.169362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7bdd05d1-6b6a-4fa4-8769-deb43fb09eed tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:31.171273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7bdd05d1-6b6a-4fa4-8769-deb43fb09eed tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:31.185405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bdd05d1-6b6a-4fa4-8769-deb43fb09eed tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:31.185916 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bdd05d1-6b6a-4fa4-8769-deb43fb09eed tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:31.186793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bdd05d1-6b6a-4fa4-8769-deb43fb09eed tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:31.187307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bdd05d1-6b6a-4fa4-8769-deb43fb09eed tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:31.293350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7bdd05d1-6b6a-4fa4-8769-deb43fb09eed tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.132003 Apr 21 14:47:31.293976 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 435/934] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:31 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:32.313020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-96c6fb3c-a914-46a1-b480-c33750a25262 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:32.314742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-96c6fb3c-a914-46a1-b480-c33750a25262 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:32.327927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96c6fb3c-a914-46a1-b480-c33750a25262 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:32.328438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96c6fb3c-a914-46a1-b480-c33750a25262 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:32.329286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96c6fb3c-a914-46a1-b480-c33750a25262 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:32.329784 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96c6fb3c-a914-46a1-b480-c33750a25262 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:32.442831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-96c6fb3c-a914-46a1-b480-c33750a25262 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.137462 Apr 21 14:47:32.443762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 500/935] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:32 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:47:33.456935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cf3b35ec-9901-4cc5-85c1-5b4799758e3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:33.458187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cf3b35ec-9901-4cc5-85c1-5b4799758e3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:33.467203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf3b35ec-9901-4cc5-85c1-5b4799758e3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:33.467714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf3b35ec-9901-4cc5-85c1-5b4799758e3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:33.468551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf3b35ec-9901-4cc5-85c1-5b4799758e3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:33.469039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf3b35ec-9901-4cc5-85c1-5b4799758e3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:33.593584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cf3b35ec-9901-4cc5-85c1-5b4799758e3c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.140785 Apr 21 14:47:33.594699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 436/936] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:33 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:34.614359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-882220ea-8c86-4fee-b452-bc847d799157 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:34.616254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-882220ea-8c86-4fee-b452-bc847d799157 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:34.629063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-882220ea-8c86-4fee-b452-bc847d799157 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:34.629578 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-882220ea-8c86-4fee-b452-bc847d799157 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:34.630479 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-882220ea-8c86-4fee-b452-bc847d799157 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:34.630974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-882220ea-8c86-4fee-b452-bc847d799157 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:34.744731 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-882220ea-8c86-4fee-b452-bc847d799157 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.138243 Apr 21 14:47:34.745339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 501/937] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:34 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:35.763145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c90fc03d-bfaa-424e-92f3-cc11b9d13c8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:35.764977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c90fc03d-bfaa-424e-92f3-cc11b9d13c8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:35.774713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c90fc03d-bfaa-424e-92f3-cc11b9d13c8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:35.775230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c90fc03d-bfaa-424e-92f3-cc11b9d13c8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:35.776074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c90fc03d-bfaa-424e-92f3-cc11b9d13c8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:35.776564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c90fc03d-bfaa-424e-92f3-cc11b9d13c8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:35.891875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c90fc03d-bfaa-424e-92f3-cc11b9d13c8b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.135957 Apr 21 14:47:35.892821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 437/938] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:35 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:36.906894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-243a5db6-baa3-4fa1-9bc1-edc9e4ee83b7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:36.908212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-243a5db6-baa3-4fa1-9bc1-edc9e4ee83b7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:36.917795 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-243a5db6-baa3-4fa1-9bc1-edc9e4ee83b7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:36.918324 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-243a5db6-baa3-4fa1-9bc1-edc9e4ee83b7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:36.919149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-243a5db6-baa3-4fa1-9bc1-edc9e4ee83b7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:36.919633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-243a5db6-baa3-4fa1-9bc1-edc9e4ee83b7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:37.028809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-243a5db6-baa3-4fa1-9bc1-edc9e4ee83b7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.127055 Apr 21 14:47:37.029550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 502/939] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:36 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:38.043603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bbaa2021-3a0e-48b9-9a42-1bf5c6c11e34 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:38.044800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bbaa2021-3a0e-48b9-9a42-1bf5c6c11e34 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:38.058450 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbaa2021-3a0e-48b9-9a42-1bf5c6c11e34 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:38.058956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbaa2021-3a0e-48b9-9a42-1bf5c6c11e34 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:38.059794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbaa2021-3a0e-48b9-9a42-1bf5c6c11e34 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:38.060257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bbaa2021-3a0e-48b9-9a42-1bf5c6c11e34 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:38.172416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bbaa2021-3a0e-48b9-9a42-1bf5c6c11e34 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.134492 Apr 21 14:47:38.173105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 438/940] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:38 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:39.189258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-48c0c3dc-7d4e-4fa7-abfa-c99d61fc2ff1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:39.190791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-48c0c3dc-7d4e-4fa7-abfa-c99d61fc2ff1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:39.202567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-48c0c3dc-7d4e-4fa7-abfa-c99d61fc2ff1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:39.203244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-48c0c3dc-7d4e-4fa7-abfa-c99d61fc2ff1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:39.204354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-48c0c3dc-7d4e-4fa7-abfa-c99d61fc2ff1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:39.205009 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-48c0c3dc-7d4e-4fa7-abfa-c99d61fc2ff1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:39.315443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-48c0c3dc-7d4e-4fa7-abfa-c99d61fc2ff1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.132151 Apr 21 14:47:39.317695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 503/941] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:39 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:40.333090 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7f7322e7-a54d-4f90-b5b3-5f126bfcd9a2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:40.334558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7f7322e7-a54d-4f90-b5b3-5f126bfcd9a2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:40.347980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f7322e7-a54d-4f90-b5b3-5f126bfcd9a2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:40.348736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f7322e7-a54d-4f90-b5b3-5f126bfcd9a2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:40.349932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f7322e7-a54d-4f90-b5b3-5f126bfcd9a2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:40.350701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f7322e7-a54d-4f90-b5b3-5f126bfcd9a2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:40.459086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7f7322e7-a54d-4f90-b5b3-5f126bfcd9a2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.133305 Apr 21 14:47:40.459845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 439/942] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:40 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:41.476154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8bed5dab-348c-47c0-a627-54247920a93b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:41.477674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8bed5dab-348c-47c0-a627-54247920a93b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:41.489798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bed5dab-348c-47c0-a627-54247920a93b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:41.490513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bed5dab-348c-47c0-a627-54247920a93b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:41.491642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bed5dab-348c-47c0-a627-54247920a93b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:41.492283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bed5dab-348c-47c0-a627-54247920a93b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:41.596764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8bed5dab-348c-47c0-a627-54247920a93b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.126961 Apr 21 14:47:41.597456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 504/943] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:41 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:42.610280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-322a0f36-626e-4f59-9a2b-e16df67e9d19 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:42.611574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-322a0f36-626e-4f59-9a2b-e16df67e9d19 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:42.624280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322a0f36-626e-4f59-9a2b-e16df67e9d19 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:42.624910 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322a0f36-626e-4f59-9a2b-e16df67e9d19 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:42.626028 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322a0f36-626e-4f59-9a2b-e16df67e9d19 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:42.626697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322a0f36-626e-4f59-9a2b-e16df67e9d19 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:42.740307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-322a0f36-626e-4f59-9a2b-e16df67e9d19 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.134071 Apr 21 14:47:42.741099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 440/944] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:42 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:43.758085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-519f2e36-be2e-4173-9a6f-513fb69a3780 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:43.759719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-519f2e36-be2e-4173-9a6f-513fb69a3780 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:43.772353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-519f2e36-be2e-4173-9a6f-513fb69a3780 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:43.773102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-519f2e36-be2e-4173-9a6f-513fb69a3780 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:43.774325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-519f2e36-be2e-4173-9a6f-513fb69a3780 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:43.774811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-519f2e36-be2e-4173-9a6f-513fb69a3780 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:43.892957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-519f2e36-be2e-4173-9a6f-513fb69a3780 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.141414 Apr 21 14:47:43.893687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 505/945] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:43 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:44.906740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0a3743b0-f925-499a-817c-f250cce0caf2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:44.907729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0a3743b0-f925-499a-817c-f250cce0caf2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:44.916679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a3743b0-f925-499a-817c-f250cce0caf2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:44.917182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a3743b0-f925-499a-817c-f250cce0caf2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:44.918034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a3743b0-f925-499a-817c-f250cce0caf2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:44.918512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a3743b0-f925-499a-817c-f250cce0caf2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:45.040648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0a3743b0-f925-499a-817c-f250cce0caf2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.138105 Apr 21 14:47:45.041670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 441/946] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:44 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:46.054837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-11ce7e12-066f-4eb2-b596-7ded9c4bca40 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:46.056034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-11ce7e12-066f-4eb2-b596-7ded9c4bca40 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:46.065562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-11ce7e12-066f-4eb2-b596-7ded9c4bca40 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:46.066146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-11ce7e12-066f-4eb2-b596-7ded9c4bca40 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:46.066985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-11ce7e12-066f-4eb2-b596-7ded9c4bca40 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:46.067505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-11ce7e12-066f-4eb2-b596-7ded9c4bca40 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:46.174489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-11ce7e12-066f-4eb2-b596-7ded9c4bca40 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.124130 Apr 21 14:47:46.175551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 506/947] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:46 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:47.190711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ea5522e4-e390-4d16-813c-6280f49207bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:47.192201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ea5522e4-e390-4d16-813c-6280f49207bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:47.204920 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea5522e4-e390-4d16-813c-6280f49207bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:47.205678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea5522e4-e390-4d16-813c-6280f49207bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:47.206886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea5522e4-e390-4d16-813c-6280f49207bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:47.212184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea5522e4-e390-4d16-813c-6280f49207bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:47.315191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ea5522e4-e390-4d16-813c-6280f49207bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.130521 Apr 21 14:47:47.315778 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 442/948] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:47 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:48.330922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dee84cde-1e36-42d8-bfa5-7bb9d4c5c120 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:48.332156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dee84cde-1e36-42d8-bfa5-7bb9d4c5c120 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:48.343420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dee84cde-1e36-42d8-bfa5-7bb9d4c5c120 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:48.344030 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dee84cde-1e36-42d8-bfa5-7bb9d4c5c120 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:48.345098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dee84cde-1e36-42d8-bfa5-7bb9d4c5c120 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:48.345689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dee84cde-1e36-42d8-bfa5-7bb9d4c5c120 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:48.451492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dee84cde-1e36-42d8-bfa5-7bb9d4c5c120 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.126337 Apr 21 14:47:48.452352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 507/949] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:48 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:49.466308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2a62cbfb-c542-45ba-a5c2-1092cec0986f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:49.467454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2a62cbfb-c542-45ba-a5c2-1092cec0986f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:49.477327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2a62cbfb-c542-45ba-a5c2-1092cec0986f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:49.477841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2a62cbfb-c542-45ba-a5c2-1092cec0986f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:49.478729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2a62cbfb-c542-45ba-a5c2-1092cec0986f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:49.479225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2a62cbfb-c542-45ba-a5c2-1092cec0986f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:49.584033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2a62cbfb-c542-45ba-a5c2-1092cec0986f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.121810 Apr 21 14:47:49.584940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 443/950] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:49 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:50.599218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-465ec932-398d-407f-a981-22ccc7dfc08d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:50.600361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-465ec932-398d-407f-a981-22ccc7dfc08d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:50.609289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-465ec932-398d-407f-a981-22ccc7dfc08d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:50.609798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-465ec932-398d-407f-a981-22ccc7dfc08d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:50.610682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-465ec932-398d-407f-a981-22ccc7dfc08d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:50.611184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-465ec932-398d-407f-a981-22ccc7dfc08d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:50.716820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-465ec932-398d-407f-a981-22ccc7dfc08d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.122632 Apr 21 14:47:50.717547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 508/951] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:50 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:51.730465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6fda5dc1-abc1-4fb9-8316-32204adca1a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:51.731616 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6fda5dc1-abc1-4fb9-8316-32204adca1a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:51.740638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6fda5dc1-abc1-4fb9-8316-32204adca1a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:51.741148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6fda5dc1-abc1-4fb9-8316-32204adca1a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:51.742034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6fda5dc1-abc1-4fb9-8316-32204adca1a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:51.742548 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6fda5dc1-abc1-4fb9-8316-32204adca1a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:51.841685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6fda5dc1-abc1-4fb9-8316-32204adca1a8 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 28638 microversion: 2.20 time: 0.115677 Apr 21 14:47:51.842507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 444/952] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:51 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 28638 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:52.855805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-28c1345a-c8f9-49bc-bcc6-7ce9e5bac997 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:52.856954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-28c1345a-c8f9-49bc-bcc6-7ce9e5bac997 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:52.866502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28c1345a-c8f9-49bc-bcc6-7ce9e5bac997 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:52.867022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28c1345a-c8f9-49bc-bcc6-7ce9e5bac997 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:52.867891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28c1345a-c8f9-49bc-bcc6-7ce9e5bac997 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:52.868387 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28c1345a-c8f9-49bc-bcc6-7ce9e5bac997 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:52.989369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-28c1345a-c8f9-49bc-bcc6-7ce9e5bac997 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 29374 microversion: 2.20 time: 0.138547 Apr 21 14:47:52.990114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 509/953] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:52 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 29374 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:54.003546 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-412f8df1-dc09-4565-8710-f2df5d79e2d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:54.004870 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-412f8df1-dc09-4565-8710-f2df5d79e2d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:54.014634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-412f8df1-dc09-4565-8710-f2df5d79e2d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:54.015146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-412f8df1-dc09-4565-8710-f2df5d79e2d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:54.016012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-412f8df1-dc09-4565-8710-f2df5d79e2d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:54.016511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-412f8df1-dc09-4565-8710-f2df5d79e2d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:54.124480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-412f8df1-dc09-4565-8710-f2df5d79e2d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 31603 microversion: 2.20 time: 0.125803 Apr 21 14:47:54.125190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 445/954] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:53 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 31603 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:55.138374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4c3c40ca-8d0e-4990-ba09-e1277d6d6b03 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:55.139509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4c3c40ca-8d0e-4990-ba09-e1277d6d6b03 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:55.148901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c3c40ca-8d0e-4990-ba09-e1277d6d6b03 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:55.149399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c3c40ca-8d0e-4990-ba09-e1277d6d6b03 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:55.150319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c3c40ca-8d0e-4990-ba09-e1277d6d6b03 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:55.150821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c3c40ca-8d0e-4990-ba09-e1277d6d6b03 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:55.262820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4c3c40ca-8d0e-4990-ba09-e1277d6d6b03 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 33240 microversion: 2.20 time: 0.128902 Apr 21 14:47:55.263535 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 510/955] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:55 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 33240 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:56.277122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5dc52eaf-ef82-49a4-a666-92e93f5aff82 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:56.278402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5dc52eaf-ef82-49a4-a666-92e93f5aff82 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:56.288129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5dc52eaf-ef82-49a4-a666-92e93f5aff82 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:56.288641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5dc52eaf-ef82-49a4-a666-92e93f5aff82 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:56.289488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5dc52eaf-ef82-49a4-a666-92e93f5aff82 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:56.290010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5dc52eaf-ef82-49a4-a666-92e93f5aff82 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:56.393223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5dc52eaf-ef82-49a4-a666-92e93f5aff82 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 34164 microversion: 2.20 time: 0.120680 Apr 21 14:47:56.393923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 446/956] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:56 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 34164 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:57.408047 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ffaa7a2d-d549-4578-aa1e-0ffe93e4eb07 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:57.409341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ffaa7a2d-d549-4578-aa1e-0ffe93e4eb07 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:57.418891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffaa7a2d-d549-4578-aa1e-0ffe93e4eb07 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:57.419403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffaa7a2d-d549-4578-aa1e-0ffe93e4eb07 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:57.420254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffaa7a2d-d549-4578-aa1e-0ffe93e4eb07 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:57.420748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffaa7a2d-d549-4578-aa1e-0ffe93e4eb07 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:57.523716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ffaa7a2d-d549-4578-aa1e-0ffe93e4eb07 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 35384 microversion: 2.20 time: 0.120515 Apr 21 14:47:57.524504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 511/957] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:57 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 35384 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:58.537948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1f866074-e416-4807-9e60-58de814afd5f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:58.539116 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1f866074-e416-4807-9e60-58de814afd5f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:58.548171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f866074-e416-4807-9e60-58de814afd5f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:58.548677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f866074-e416-4807-9e60-58de814afd5f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:58.549499 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f866074-e416-4807-9e60-58de814afd5f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:58.550346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1f866074-e416-4807-9e60-58de814afd5f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:58.654483 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1f866074-e416-4807-9e60-58de814afd5f tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 36870 microversion: 2.20 time: 0.121218 Apr 21 14:47:58.655202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 447/958] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:58 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 36870 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:47:59.668622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a4c7cb3-dc54-4d2c-a8c3-9fe0c2af2064 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:47:59.669838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a4c7cb3-dc54-4d2c-a8c3-9fe0c2af2064 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:47:59.679905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a4c7cb3-dc54-4d2c-a8c3-9fe0c2af2064 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:59.680412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a4c7cb3-dc54-4d2c-a8c3-9fe0c2af2064 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:59.681266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a4c7cb3-dc54-4d2c-a8c3-9fe0c2af2064 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:47:59.681753 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a4c7cb3-dc54-4d2c-a8c3-9fe0c2af2064 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:47:59.787303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a4c7cb3-dc54-4d2c-a8c3-9fe0c2af2064 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 38182 microversion: 2.20 time: 0.123227 Apr 21 14:47:59.788042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 512/959] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:47:59 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 38182 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:48:00.801331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-198864b7-fee3-44cc-bfe2-655999eec57b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:00.802697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-198864b7-fee3-44cc-bfe2-655999eec57b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:00.811782 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-198864b7-fee3-44cc-bfe2-655999eec57b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:00.812293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-198864b7-fee3-44cc-bfe2-655999eec57b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:00.813134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-198864b7-fee3-44cc-bfe2-655999eec57b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:00.813628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-198864b7-fee3-44cc-bfe2-655999eec57b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:00.921560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-198864b7-fee3-44cc-bfe2-655999eec57b tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 38182 microversion: 2.20 time: 0.124904 Apr 21 14:48:00.922399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 448/960] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:48:00 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 38182 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:48:01.935227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-24841d39-b419-41d4-9cb9-247c81205ee9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:01.936276 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-24841d39-b419-41d4-9cb9-247c81205ee9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:01.945346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24841d39-b419-41d4-9cb9-247c81205ee9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:01.945845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24841d39-b419-41d4-9cb9-247c81205ee9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:01.946707 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24841d39-b419-41d4-9cb9-247c81205ee9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:01.947250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24841d39-b419-41d4-9cb9-247c81205ee9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:02.056361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-24841d39-b419-41d4-9cb9-247c81205ee9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 38182 microversion: 2.20 time: 0.125734 Apr 21 14:48:02.057105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 513/961] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:48:01 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 38182 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:48:03.070576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a1365cd3-f3e2-41fd-9ac6-f87b46b4dffd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:03.071726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a1365cd3-f3e2-41fd-9ac6-f87b46b4dffd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:03.080807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1365cd3-f3e2-41fd-9ac6-f87b46b4dffd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:03.081313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1365cd3-f3e2-41fd-9ac6-f87b46b4dffd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:03.082182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1365cd3-f3e2-41fd-9ac6-f87b46b4dffd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:03.082671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1365cd3-f3e2-41fd-9ac6-f87b46b4dffd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:03.185211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a1365cd3-f3e2-41fd-9ac6-f87b46b4dffd tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 38182 microversion: 2.20 time: 0.119078 Apr 21 14:48:03.185980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 449/962] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:48:03 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 38182 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:48:04.204395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7aae232d-4844-4f2a-99e4-0a336b8c01bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:04.205624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7aae232d-4844-4f2a-99e4-0a336b8c01bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:04.215104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7aae232d-4844-4f2a-99e4-0a336b8c01bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:04.215619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7aae232d-4844-4f2a-99e4-0a336b8c01bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:04.216475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7aae232d-4844-4f2a-99e4-0a336b8c01bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:04.216969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7aae232d-4844-4f2a-99e4-0a336b8c01bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:04.316250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7aae232d-4844-4f2a-99e4-0a336b8c01bf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 200 len: 38323 microversion: 2.20 time: 0.116313 Apr 21 14:48:04.316868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 514/963] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:48:04 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 38323 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:48:04.328507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a408b222-a749-4006-aa6e-7848000d5fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:04.329149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a408b222-a749-4006-aa6e-7848000d5fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:04.338092 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a408b222-a749-4006-aa6e-7848000d5fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:04.338603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a408b222-a749-4006-aa6e-7848000d5fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:04.339443 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a408b222-a749-4006-aa6e-7848000d5fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:04.339929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a408b222-a749-4006-aa6e-7848000d5fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:04.401635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a408b222-a749-4006-aa6e-7848000d5fee tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/ips" status: 200 len: 152 microversion: 2.20 time: 0.077648 Apr 21 14:48:04.402312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 450/964] 10.222.0.24 () {60 vars in 1279 bytes} [Wed Apr 21 14:48:04 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/ips => generated 152 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:48:06.737832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-82b61c8e-29a9-4eed-858a-85146a33de1a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:06.738543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-82b61c8e-29a9-4eed-858a-85146a33de1a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:06.747646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-82b61c8e-29a9-4eed-858a-85146a33de1a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:06.748149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-82b61c8e-29a9-4eed-858a-85146a33de1a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:06.748963 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-82b61c8e-29a9-4eed-858a-85146a33de1a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:06.749464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-82b61c8e-29a9-4eed-858a-85146a33de1a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:06.813207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-82b61c8e-29a9-4eed-858a-85146a33de1a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lazy-loading 'flavor' on Instance uuid 77b1c253-7437-4a43-bc08-a0626125cd82 {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:48:07.166556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-82b61c8e-29a9-4eed-858a-85146a33de1a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 202 len: 0 microversion: 2.20 time: 0.432886 Apr 21 14:48:07.167421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 515/965] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:48:06 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:48:07.178527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:07.179204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:07.189554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:07.190492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:07.191888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:07.192658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:07.422312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:07.432677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:07.434422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:07.435665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-28df146f-679a-41b5-8310-8072376b69e7 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.261847 Apr 21 14:48:07.436286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 451/966] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:07 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:08.458515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:08.459507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:08.469271 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:08.469809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:08.470657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:08.471150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:08.698689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:08.709050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:08.710719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:08.711974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aeefe4d6-4591-47ce-a7cb-bcf1662891b3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.259353 Apr 21 14:48:08.712636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 516/967] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:08 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:09.732292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:09.732855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:09.741965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:09.742528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:09.743382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:09.743939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:09.975495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:09.985818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:09.987465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:09.988716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f616ea81-63ef-4ad3-9131-835e747c0938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.260745 Apr 21 14:48:09.989334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 452/968] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:09 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:11.008872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:11.009693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:11.018723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:11.019225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:11.020063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:11.020543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:11.266358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:11.276466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:11.278211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:11.279470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fe45889b-e8a9-40c1-9bbd-328fdf28e6e5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.274852 Apr 21 14:48:11.280089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 517/969] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:11 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:12.300278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:12.300966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:12.309789 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:12.310329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:12.311177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:12.311642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:12.556064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:12.567820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:12.569553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:12.570813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ef219a13-5c4e-4051-8280-061501504864 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.275498 Apr 21 14:48:12.571448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 453/970] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:12 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:13.591518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:13.592284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:13.600780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:13.601362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:13.602361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:13.602949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:13.839494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:13.849816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:13.851596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:13.852851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7ab6f01d-4dd7-4a64-8e8d-83672fd4ac5d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.267060 Apr 21 14:48:13.853591 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 518/971] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:13 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:14.873359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:14.874035 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:14.882869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:14.883379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:14.884224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:14.884717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:15.126492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:15.136897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:15.138665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:15.139904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1a54f184-026b-4c29-8926-500d022555b0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.270947 Apr 21 14:48:15.140534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 454/972] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:14 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:16.160343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:16.160943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:16.170192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:16.170705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:16.171559 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:16.172049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:16.419983 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:16.430712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:16.432467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:16.433719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-435cc045-e9a7-4ae5-986d-6e720c9f66d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.277734 Apr 21 14:48:16.434386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 519/973] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:16 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:17.454278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:17.454886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:17.463632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:17.464144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:17.464992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:17.465489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:17.702627 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:17.713504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:17.715194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:17.716402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a59e85cd-b700-4a93-809b-a4a3212df244 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.266352 Apr 21 14:48:17.717020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 455/974] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:17 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:18.738411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:18.739065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:18.747474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:18.748005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:18.748824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:18.749304 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:18.978469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:18.999930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:19.001945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:19.003345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e82b5d14-8b54-47da-b577-7b04fe759fdf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1744 microversion: 2.20 time: 0.269258 Apr 21 14:48:19.004014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 520/975] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:18 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1744 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:20.024607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:20.025912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:20.034299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:20.035168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:20.036027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:20.036511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:20.408474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0efc15a9-a134-4a52-a9b3-fa81fcf1709f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:20.409053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0efc15a9-a134-4a52-a9b3-fa81fcf1709f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:20.418793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0efc15a9-a134-4a52-a9b3-fa81fcf1709f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:20.419315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0efc15a9-a134-4a52-a9b3-fa81fcf1709f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:20.420209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0efc15a9-a134-4a52-a9b3-fa81fcf1709f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:20.420676 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0efc15a9-a134-4a52-a9b3-fa81fcf1709f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:20.500937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:20.514505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:20.516519 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:20.518053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8aca6b80-9a4d-47fb-8803-7592b7aef5c6 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1744 microversion: 2.20 time: 0.498767 Apr 21 14:48:20.519100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 456/976] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:20 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1744 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:20.614148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-0efc15a9-a134-4a52-a9b3-fa81fcf1709f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lazy-loading 'services' on Instance uuid eb0ca663-e263-49ed-b0c6-874b504da2e3 {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:48:20.781272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0efc15a9-a134-4a52-a9b3-fa81fcf1709f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "DELETE /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/os-volume_attachments/667020d6-b6f5-4d5c-9f50-5df7b3422832" status: 202 len: 0 microversion: 2.1 time: 0.376440 Apr 21 14:48:20.785246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 521/977] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:48:20 2021] DELETE /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/os-volume_attachments/667020d6-b6f5-4d5c-9f50-5df7b3422832 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:48:21.165297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-84eac296-3e21-4adc-b5d9-3d5a6d4e1e11 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:21.166521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-84eac296-3e21-4adc-b5d9-3d5a6d4e1e11 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:21.170552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-16a443d4-dc09-49ba-8c67-0466aca23410 req-8ba4364b-c475-4aa5-94ad-fe0879fe447a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ad6998-eddd-4b1f-b1f8-adada36a72a7", "tag": "cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:21.172466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:48:21.172466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:48:21.175921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84eac296-3e21-4adc-b5d9-3d5a6d4e1e11 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:21.176437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84eac296-3e21-4adc-b5d9-3d5a6d4e1e11 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:21.177301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84eac296-3e21-4adc-b5d9-3d5a6d4e1e11 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:21.177796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84eac296-3e21-4adc-b5d9-3d5a6d4e1e11 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:21.182757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-16a443d4-dc09-49ba-8c67-0466aca23410 req-8ba4364b-c475-4aa5-94ad-fe0879fe447a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:21.183256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-16a443d4-dc09-49ba-8c67-0466aca23410 req-8ba4364b-c475-4aa5-94ad-fe0879fe447a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:21.202752 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-16a443d4-dc09-49ba-8c67-0466aca23410 req-8ba4364b-c475-4aa5-94ad-fe0879fe447a service nova] Creating event network-changed:cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7 for instance 96ad6998-eddd-4b1f-b1f8-adada36a72a7 on hv-cinder-78638 Apr 21 14:48:21.208749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-16a443d4-dc09-49ba-8c67-0466aca23410 req-8ba4364b-c475-4aa5-94ad-fe0879fe447a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042665 Apr 21 14:48:21.209594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 522/978] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:48:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:48:21.252747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-84eac296-3e21-4adc-b5d9-3d5a6d4e1e11 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:48:21.380575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-84eac296-3e21-4adc-b5d9-3d5a6d4e1e11 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "DELETE /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 204 len: 0 microversion: 2.1 time: 0.219028 Apr 21 14:48:21.382351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 457/979] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:48:21 2021] DELETE /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:48:21.391942 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b1f1b314-00b3-43ea-b3da-3ab440ab75ce tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:21.392715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b1f1b314-00b3-43ea-b3da-3ab440ab75ce tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:21.401362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1f1b314-00b3-43ea-b3da-3ab440ab75ce tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:21.401874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1f1b314-00b3-43ea-b3da-3ab440ab75ce tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:21.402742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1f1b314-00b3-43ea-b3da-3ab440ab75ce tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:21.403197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1f1b314-00b3-43ea-b3da-3ab440ab75ce tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:21.539757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:21.540576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:21.552337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:21.553154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:21.554208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:21.555130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:21.647840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b1f1b314-00b3-43ea-b3da-3ab440ab75ce tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:21.658357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b1f1b314-00b3-43ea-b3da-3ab440ab75ce tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1567 microversion: 2.1 time: 0.270934 Apr 21 14:48:21.659359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 523/980] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:21 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:21.883772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:21.894878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:21.896647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:21.898210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-42b56c41-1287-4ad2-9da8-02b5d4528ba0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1744 microversion: 2.20 time: 0.363405 Apr 21 14:48:21.898839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 458/981] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:21 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1744 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:22.044492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-322421ad-f70b-4222-9ea8-fc8983eab2a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:22.061525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322421ad-f70b-4222-9ea8-fc8983eab2a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:22.062383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-322421ad-f70b-4222-9ea8-fc8983eab2a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:22.139238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-322421ad-f70b-4222-9ea8-fc8983eab2a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Going to try to stop instance {{(pid=100564) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 21 14:48:22.220958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-322421ad-f70b-4222-9ea8-fc8983eab2a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 202 len: 0 microversion: 2.1 time: 0.180854 Apr 21 14:48:22.222076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 524/982] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:48:22 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:48:22.236193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9ec4355d-24fd-4ff0-830d-523e8212bbee tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:22.236882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9ec4355d-24fd-4ff0-830d-523e8212bbee tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:22.246730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ec4355d-24fd-4ff0-830d-523e8212bbee tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:22.247530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ec4355d-24fd-4ff0-830d-523e8212bbee tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:22.248579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ec4355d-24fd-4ff0-830d-523e8212bbee tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:22.249654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ec4355d-24fd-4ff0-830d-523e8212bbee tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:22.490156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9ec4355d-24fd-4ff0-830d-523e8212bbee tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:22.499710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9ec4355d-24fd-4ff0-830d-523e8212bbee tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1678 microversion: 2.1 time: 0.273248 Apr 21 14:48:22.500414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 459/983] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:22 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:22.679584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c5c8c2ef-c1dd-4b9e-80f0-b1be20f00454 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:22.680490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c5c8c2ef-c1dd-4b9e-80f0-b1be20f00454 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:22.689380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c5c8c2ef-c1dd-4b9e-80f0-b1be20f00454 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:22.689887 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c5c8c2ef-c1dd-4b9e-80f0-b1be20f00454 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:22.690716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c5c8c2ef-c1dd-4b9e-80f0-b1be20f00454 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:22.691571 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c5c8c2ef-c1dd-4b9e-80f0-b1be20f00454 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:22.710756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a59257d8-f268-4b79-b2f0-986c9eaf5c4b req-b6a67011-3978-446f-bbf5-d0653266d8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b1c253-7437-4a43-bc08-a0626125cd82", "name": "network-vif-plugged", "status": "completed", "tag": "cc544713-b84a-4e45-b04d-b437a6b4c09b"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:22.712555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:48:22.712555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:48:22.722017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a59257d8-f268-4b79-b2f0-986c9eaf5c4b req-b6a67011-3978-446f-bbf5-d0653266d8d3 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:22.722528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a59257d8-f268-4b79-b2f0-986c9eaf5c4b req-b6a67011-3978-446f-bbf5-d0653266d8d3 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:22.741499 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a59257d8-f268-4b79-b2f0-986c9eaf5c4b req-b6a67011-3978-446f-bbf5-d0653266d8d3 service nova] Creating event network-vif-plugged:cc544713-b84a-4e45-b04d-b437a6b4c09b for instance 77b1c253-7437-4a43-bc08-a0626125cd82 on hv-cinder-78638 Apr 21 14:48:22.747074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a59257d8-f268-4b79-b2f0-986c9eaf5c4b req-b6a67011-3978-446f-bbf5-d0653266d8d3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040602 Apr 21 14:48:22.747733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 460/984] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:48:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:48:22.920870 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:22.921868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:22.932455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:22.932969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:22.933907 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:22.934467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:22.957651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c5c8c2ef-c1dd-4b9e-80f0-b1be20f00454 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:22.967962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c5c8c2ef-c1dd-4b9e-80f0-b1be20f00454 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1449 microversion: 2.1 time: 0.293266 Apr 21 14:48:22.968604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 525/985] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:22 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1449 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:23.163021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:23.177595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:23.180214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:23.181763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bec7ac60-4743-4cc8-b228-ef9c0f7adadf tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1744 microversion: 2.20 time: 0.267032 Apr 21 14:48:23.182450 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 461/986] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:22 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1744 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:23.520084 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ee6b9a0b-6632-4a3b-bf90-cc42b7df1a51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:23.520790 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ee6b9a0b-6632-4a3b-bf90-cc42b7df1a51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:23.530266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee6b9a0b-6632-4a3b-bf90-cc42b7df1a51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:23.530819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee6b9a0b-6632-4a3b-bf90-cc42b7df1a51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:23.531698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee6b9a0b-6632-4a3b-bf90-cc42b7df1a51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:23.532200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee6b9a0b-6632-4a3b-bf90-cc42b7df1a51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:23.908248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ee6b9a0b-6632-4a3b-bf90-cc42b7df1a51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:23.917633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ee6b9a0b-6632-4a3b-bf90-cc42b7df1a51 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1678 microversion: 2.1 time: 0.402248 Apr 21 14:48:23.918330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 526/987] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:23 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1678 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:23.987304 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-778ca4e9-8907-4cf7-b1f1-8b0175e2a9a8 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:23.987918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-778ca4e9-8907-4cf7-b1f1-8b0175e2a9a8 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:23.996869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-778ca4e9-8907-4cf7-b1f1-8b0175e2a9a8 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:23.997602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-778ca4e9-8907-4cf7-b1f1-8b0175e2a9a8 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:23.998268 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-778ca4e9-8907-4cf7-b1f1-8b0175e2a9a8 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:23.998737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-778ca4e9-8907-4cf7-b1f1-8b0175e2a9a8 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:24.202426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:24.203124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:24.212511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:24.213116 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:24.213968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:24.214497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:24.437380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:24.447359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:24.449059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:24.450487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aaf2f261-8d6c-4d0e-85a1-5698050f65e3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1744 microversion: 2.20 time: 0.252938 Apr 21 14:48:24.451159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 527/988] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:24 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1744 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:24.527497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-778ca4e9-8907-4cf7-b1f1-8b0175e2a9a8 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:24.538856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-778ca4e9-8907-4cf7-b1f1-8b0175e2a9a8 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1449 microversion: 2.1 time: 0.556122 Apr 21 14:48:24.539757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 462/989] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:23 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1449 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:24.632070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-8fe61738-03c5-4334-96e4-7c7d6b299a3f req-166d1bc6-4f22-4756-896a-f24110562a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ad6998-eddd-4b1f-b1f8-adada36a72a7", "name": "network-vif-deleted", "tag": "cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:24.633756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:48:24.633756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:48:24.644009 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-8fe61738-03c5-4334-96e4-7c7d6b299a3f req-166d1bc6-4f22-4756-896a-f24110562a00 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:24.644541 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-8fe61738-03c5-4334-96e4-7c7d6b299a3f req-166d1bc6-4f22-4756-896a-f24110562a00 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:24.664245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-8fe61738-03c5-4334-96e4-7c7d6b299a3f req-166d1bc6-4f22-4756-896a-f24110562a00 service nova] Creating event network-vif-deleted:cf7ef8c7-a38d-4fd5-b21a-c298de3e6ee7 for instance 96ad6998-eddd-4b1f-b1f8-adada36a72a7 on hv-cinder-78638 Apr 21 14:48:24.669871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-8fe61738-03c5-4334-96e4-7c7d6b299a3f req-166d1bc6-4f22-4756-896a-f24110562a00 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042589 Apr 21 14:48:24.670530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 528/990] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:48:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:48:24.938260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bf09082d-7e75-4436-98c3-3f5ddfc8af97 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:24.938944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bf09082d-7e75-4436-98c3-3f5ddfc8af97 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:24.947888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf09082d-7e75-4436-98c3-3f5ddfc8af97 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:24.948402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf09082d-7e75-4436-98c3-3f5ddfc8af97 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:24.949287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf09082d-7e75-4436-98c3-3f5ddfc8af97 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:24.949798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf09082d-7e75-4436-98c3-3f5ddfc8af97 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:25.204453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bf09082d-7e75-4436-98c3-3f5ddfc8af97 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:25.215170 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bf09082d-7e75-4436-98c3-3f5ddfc8af97 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1678 microversion: 2.1 time: 0.281105 Apr 21 14:48:25.216134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 463/991] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:24 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:25.471005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:25.471760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:25.480067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:25.480583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:25.481461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:25.481951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:25.557974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:25.558631 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:25.568451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:25.568998 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:25.569940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:25.570454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:25.652505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:25.653013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:25.653527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lazy-loading 'fault' on Instance uuid 96ad6998-eddd-4b1f-b1f8-adada36a72a7 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:48:25.740358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b688274f9d8b4061afbf14e6d4646764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d44a65707b47e1b0190ca77b504c5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:25.750272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bc30fe32-254e-428c-abef-0d3c28006ebc tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 200 len: 1224 microversion: 2.1 time: 0.196761 Apr 21 14:48:25.750931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 464/992] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:25 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:25.756996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:25.768356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:25.770330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:25.771801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5b1e7b68-471b-40a7-aa44-eb1e926377a3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1739 microversion: 2.20 time: 0.305454 Apr 21 14:48:25.772655 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 529/993] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:25 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:26.235833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b335af55-2488-4533-b373-4340baed077c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:26.236792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b335af55-2488-4533-b373-4340baed077c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:26.247353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b335af55-2488-4533-b373-4340baed077c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:26.248299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b335af55-2488-4533-b373-4340baed077c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:26.249866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b335af55-2488-4533-b373-4340baed077c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:26.250802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b335af55-2488-4533-b373-4340baed077c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:26.537551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b335af55-2488-4533-b373-4340baed077c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:26.548503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b335af55-2488-4533-b373-4340baed077c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1678 microversion: 2.1 time: 0.317608 Apr 21 14:48:26.549683 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 465/994] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:26 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1678 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:26.768075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-32f2cd87-36d7-4696-a9da-7bb3f7acdf9d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:26.769424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-32f2cd87-36d7-4696-a9da-7bb3f7acdf9d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [instance: 96ad6998-eddd-4b1f-b1f8-adada36a72a7] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:26.778901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-32f2cd87-36d7-4696-a9da-7bb3f7acdf9d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:26.779538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-32f2cd87-36d7-4696-a9da-7bb3f7acdf9d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:26.780618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-32f2cd87-36d7-4696-a9da-7bb3f7acdf9d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:26.781498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-32f2cd87-36d7-4696-a9da-7bb3f7acdf9d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:26.791169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:26.791857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:26.803392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:26.803909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:26.804767 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:26.805259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:26.841265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-32f2cd87-36d7-4696-a9da-7bb3f7acdf9d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] HTTP exception thrown: Instance 96ad6998-eddd-4b1f-b1f8-adada36a72a7 could not be found. Apr 21 14:48:26.842320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-32f2cd87-36d7-4696-a9da-7bb3f7acdf9d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Returning 404 to user: Instance 96ad6998-eddd-4b1f-b1f8-adada36a72a7 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:48:26.843393 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-32f2cd87-36d7-4696-a9da-7bb3f7acdf9d tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7" status: 404 len: 111 microversion: 2.1 time: 0.079515 Apr 21 14:48:26.844195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 530/995] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:26 2021] GET /compute/v2.1/servers/96ad6998-eddd-4b1f-b1f8-adada36a72a7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:48:27.163876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:27.177617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:27.179699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:27.180599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d3362c91-b833-4ee9-8dcf-6a988d46cae2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1739 microversion: 2.20 time: 0.393758 Apr 21 14:48:27.181473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 466/996] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:26 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1739 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:48:27.231990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7c73ea66-a068-462e-ad99-683c6c4b1168 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] Calling method '.version_select at 0x7f19e3cd1b70>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:27.236263 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7c73ea66-a068-462e-ad99-683c6c4b1168 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [e9b2a71a-a2e3-4378-802e-c067726e53ca] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 21 14:48:27.569075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0741251e-d382-4502-be3c-9ab6d11f0322 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:27.570204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0741251e-d382-4502-be3c-9ab6d11f0322 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:27.579707 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0741251e-d382-4502-be3c-9ab6d11f0322 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:27.580389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0741251e-d382-4502-be3c-9ab6d11f0322 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:27.581325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0741251e-d382-4502-be3c-9ab6d11f0322 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:27.581893 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0741251e-d382-4502-be3c-9ab6d11f0322 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:27.820430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0741251e-d382-4502-be3c-9ab6d11f0322 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:27.830550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0741251e-d382-4502-be3c-9ab6d11f0322 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1678 microversion: 2.1 time: 0.266454 Apr 21 14:48:27.841470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 467/997] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:27 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1678 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:28.201160 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:28.201953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:28.210636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:28.211255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:28.212206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:28.212794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:28.257016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [None req-7c73ea66-a068-462e-ad99-683c6c4b1168 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] [e9b2a71a-a2e3-4378-802e-c067726e53ca] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 34666. Apr 21 14:48:28.278771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7c73ea66-a068-462e-ad99-683c6c4b1168 tempest-TestShelveInstance-1945417571 tempest-TestShelveInstance-1945417571-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-482307021" status: 202 len: 0 microversion: 2.1 time: 1.050875 Apr 21 14:48:28.279632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 531/998] 10.222.0.24 () {58 vars in 1241 bytes} [Wed Apr 21 14:48:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-482307021 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:48:28.475059 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:28.497476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:28.499374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:28.500675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d174618d-c198-44ad-b909-a2dded091578 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1739 microversion: 2.20 time: 0.304138 Apr 21 14:48:28.501668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 468/999] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:28 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:48:28.850195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b4d7e324-e7b9-4fb9-9970-297cec23a626 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:28.851161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b4d7e324-e7b9-4fb9-9970-297cec23a626 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:28.864441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4d7e324-e7b9-4fb9-9970-297cec23a626 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:28.865423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4d7e324-e7b9-4fb9-9970-297cec23a626 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:28.866696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4d7e324-e7b9-4fb9-9970-297cec23a626 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:28.867864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4d7e324-e7b9-4fb9-9970-297cec23a626 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:29.288159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b4d7e324-e7b9-4fb9-9970-297cec23a626 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:29.298587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b4d7e324-e7b9-4fb9-9970-297cec23a626 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1678 microversion: 2.1 time: 0.453037 Apr 21 14:48:29.311669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 532/1000] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:28 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1678 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:29.521552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:29.522396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:29.536476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:29.537001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:29.537890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:29.538417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:29.958784 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:30.003807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:30.005481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:30.006850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-07122d82-b3e4-4d48-a72e-042555ba3f36 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1739 microversion: 2.20 time: 0.489763 Apr 21 14:48:30.019107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 469/1001] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:29 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1739 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:30.541229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72714e28-590b-4447-b3cf-36a87e62afea tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:30.541967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-72714e28-590b-4447-b3cf-36a87e62afea tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:30.551637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72714e28-590b-4447-b3cf-36a87e62afea tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:30.552222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72714e28-590b-4447-b3cf-36a87e62afea tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:30.554073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72714e28-590b-4447-b3cf-36a87e62afea tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:30.555294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72714e28-590b-4447-b3cf-36a87e62afea tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:31.026506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:31.027149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:31.042642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:31.042642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:31.043595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:31.044411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:31.057739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-72714e28-590b-4447-b3cf-36a87e62afea tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:31.088499 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-72714e28-590b-4447-b3cf-36a87e62afea tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1678 microversion: 2.1 time: 0.769655 Apr 21 14:48:31.099428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 533/1002] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:30 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1678 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:31.582986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:31.606648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:31.612681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:31.613426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9fc02219-9326-4584-8bca-e48d5f7e6914 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1739 microversion: 2.20 time: 0.590640 Apr 21 14:48:31.615604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 470/1003] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:31 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1739 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:32.108867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-412c355e-f321-45bf-bc4f-98f67aedde03 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:32.109523 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-412c355e-f321-45bf-bc4f-98f67aedde03 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:32.119447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-412c355e-f321-45bf-bc4f-98f67aedde03 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:32.120388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-412c355e-f321-45bf-bc4f-98f67aedde03 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:32.121510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-412c355e-f321-45bf-bc4f-98f67aedde03 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:32.122109 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-412c355e-f321-45bf-bc4f-98f67aedde03 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:32.512923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-412c355e-f321-45bf-bc4f-98f67aedde03 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:32.526819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-412c355e-f321-45bf-bc4f-98f67aedde03 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1678 microversion: 2.1 time: 0.422654 Apr 21 14:48:32.527641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 534/1004] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:32 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1678 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:32.648502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:32.649675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:32.668760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:32.670847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:32.672220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:32.672966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:33.545605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-014bf98d-144e-4a9e-ac53-9ae44621b0de tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:33.546303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-014bf98d-144e-4a9e-ac53-9ae44621b0de tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:33.560378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-014bf98d-144e-4a9e-ac53-9ae44621b0de tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:33.560903 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-014bf98d-144e-4a9e-ac53-9ae44621b0de tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:33.561788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-014bf98d-144e-4a9e-ac53-9ae44621b0de tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:33.562354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-014bf98d-144e-4a9e-ac53-9ae44621b0de tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:33.856241 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-014bf98d-144e-4a9e-ac53-9ae44621b0de tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:33.867053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-014bf98d-144e-4a9e-ac53-9ae44621b0de tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1655 microversion: 2.1 time: 0.325763 Apr 21 14:48:33.867714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 535/1005] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:33 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1655 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:48:33.885402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-67f932cd-fe88-4c61-8fcb-b1fe33e5ffa4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:33.893787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67f932cd-fe88-4c61-8fcb-b1fe33e5ffa4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:33.894377 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67f932cd-fe88-4c61-8fcb-b1fe33e5ffa4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:33.965440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-67f932cd-fe88-4c61-8fcb-b1fe33e5ffa4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Going to try to start instance {{(pid=100564) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 21 14:48:34.075356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-67f932cd-fe88-4c61-8fcb-b1fe33e5ffa4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action" status: 202 len: 0 microversion: 2.1 time: 0.193635 Apr 21 14:48:34.076066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 536/1006] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:48:33 2021] POST /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:48:34.105669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3f170da-a2d3-471d-a012-896731aa234d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:34.107345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a3f170da-a2d3-471d-a012-896731aa234d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:34.116527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3f170da-a2d3-471d-a012-896731aa234d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:34.117204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3f170da-a2d3-471d-a012-896731aa234d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:34.118143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3f170da-a2d3-471d-a012-896731aa234d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:34.118642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3f170da-a2d3-471d-a012-896731aa234d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:34.193819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:34.207851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:34.209535 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:34.210871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-53d2c46b-96e1-421a-83f9-41c77ef788c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1739 microversion: 2.20 time: 1.568411 Apr 21 14:48:34.211500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 471/1007] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:32 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1739 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:34.470732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a3f170da-a2d3-471d-a012-896731aa234d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:34.494956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a3f170da-a2d3-471d-a012-896731aa234d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1664 microversion: 2.1 time: 0.402610 Apr 21 14:48:34.502718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 537/1008] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:34 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1664 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:35.013085 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:48:35.013698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:48:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:48:35.237411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:35.239062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:35.249194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:35.249697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:35.250587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:35.251076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:35.523565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-96920a34-b602-4ed4-8082-06cf6b4ba60c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:35.524593 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-96920a34-b602-4ed4-8082-06cf6b4ba60c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:35.535308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96920a34-b602-4ed4-8082-06cf6b4ba60c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:35.536123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96920a34-b602-4ed4-8082-06cf6b4ba60c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:35.537183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96920a34-b602-4ed4-8082-06cf6b4ba60c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:35.538093 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96920a34-b602-4ed4-8082-06cf6b4ba60c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:35.799291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:35.813576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:35.817081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:35.819024 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a9de433b-f68f-4b7e-85d1-72f1b1735b5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1739 microversion: 2.20 time: 0.586226 Apr 21 14:48:35.821143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 472/1009] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:35 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:36.072143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-96920a34-b602-4ed4-8082-06cf6b4ba60c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:36.094730 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-96920a34-b602-4ed4-8082-06cf6b4ba60c tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1664 microversion: 2.1 time: 0.576136 Apr 21 14:48:36.095614 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 538/1010] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:35 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1664 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:36.843965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:36.844544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:36.852706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:36.853285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:36.854167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:36.854644 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:37.114577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-767352e7-07f3-4514-a788-3e616ef91068 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:37.115282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-767352e7-07f3-4514-a788-3e616ef91068 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:37.123764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-767352e7-07f3-4514-a788-3e616ef91068 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:37.124266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-767352e7-07f3-4514-a788-3e616ef91068 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:37.125101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-767352e7-07f3-4514-a788-3e616ef91068 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:37.125585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-767352e7-07f3-4514-a788-3e616ef91068 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:37.366242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-767352e7-07f3-4514-a788-3e616ef91068 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:37.376359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-767352e7-07f3-4514-a788-3e616ef91068 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1668 microversion: 2.1 time: 0.265769 Apr 21 14:48:37.377104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 539/1011] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:48:37 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1668 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:48:37.568973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:37.579679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:37.581360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:37.582665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dcdd9532-22dd-4fc2-ad65-bea122e13e7d tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1739 microversion: 2.20 time: 0.742904 Apr 21 14:48:37.583362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 473/1012] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:36 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1739 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:48:38.603569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:38.604379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:38.615004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:38.615499 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:38.616626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:38.617163 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:39.026018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:39.046274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:39.046274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:39.046274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b5bb4839-7c19-4842-8bce-e08fd201e9dc tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1721 microversion: 2.20 time: 0.440148 Apr 21 14:48:39.046918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 540/1013] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:38 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1721 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:40.060257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:40.061048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:40.070258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:40.070883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:40.071684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:40.072459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:40.301234 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:40.311476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:40.313147 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:40.314440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-780e322e-2a64-4067-bb9a-01c942062e9e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1721 microversion: 2.20 time: 0.258631 Apr 21 14:48:40.315249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 474/1014] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:40 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:40.607111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:48:40.607413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:48:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:48:41.345291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:41.346188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:41.360585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:41.361650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:41.362954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:41.363554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:41.617333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:41.630900 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:41.633071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:41.635533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ad7c900-71b0-4fcc-b6a1-25286912dfac tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1664 microversion: 2.20 time: 0.294189 Apr 21 14:48:41.636757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 541/1015] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:41 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1664 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:41.670945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-14b340f4-7131-4c3b-b339-9e2b5cdbfae1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1a80b95-7c59-4d74-b941-7df47c40bb35"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:41.674067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-14b340f4-7131-4c3b-b339-9e2b5cdbfae1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:41.690141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14b340f4-7131-4c3b-b339-9e2b5cdbfae1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:41.691003 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14b340f4-7131-4c3b-b339-9e2b5cdbfae1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:41.692516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14b340f4-7131-4c3b-b339-9e2b5cdbfae1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:41.693370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14b340f4-7131-4c3b-b339-9e2b5cdbfae1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:42.246188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-14b340f4-7131-4c3b-b339-9e2b5cdbfae1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.585574 Apr 21 14:48:42.246872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 475/1016] 10.222.0.24 () {62 vars in 1354 bytes} [Wed Apr 21 14:48:41 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/os-volume_attachments => generated 188 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:48:42.377178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-809dba2c-a6ac-4d92-b4a5-87c6d9c80fd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:42.377869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-809dba2c-a6ac-4d92-b4a5-87c6d9c80fd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:42.386335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-809dba2c-a6ac-4d92-b4a5-87c6d9c80fd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:42.386842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-809dba2c-a6ac-4d92-b4a5-87c6d9c80fd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:42.387703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-809dba2c-a6ac-4d92-b4a5-87c6d9c80fd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:42.388195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-809dba2c-a6ac-4d92-b4a5-87c6d9c80fd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:42.733373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-9c2bff27-0346-49b6-a497-ae80cafd6656 req-b358c41c-60d3-41f9-ba45-98ea5d45d136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b1c253-7437-4a43-bc08-a0626125cd82", "name": "network-vif-unplugged", "status": "completed", "tag": "cc544713-b84a-4e45-b04d-b437a6b4c09b"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:42.735444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:48:42.735444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:48:42.753685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-9c2bff27-0346-49b6-a497-ae80cafd6656 req-b358c41c-60d3-41f9-ba45-98ea5d45d136 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:42.754452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-9c2bff27-0346-49b6-a497-ae80cafd6656 req-b358c41c-60d3-41f9-ba45-98ea5d45d136 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:42.776845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.compute.server_external_events [req-9c2bff27-0346-49b6-a497-ae80cafd6656 req-b358c41c-60d3-41f9-ba45-98ea5d45d136 service nova] Unable to find a host for instance 77b1c253-7437-4a43-bc08-a0626125cd82. Dropping event network-vif-unplugged {{(pid=100563) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 21 14:48:42.778053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-9c2bff27-0346-49b6-a497-ae80cafd6656 req-b358c41c-60d3-41f9-ba45-98ea5d45d136 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049165 Apr 21 14:48:42.778841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 476/1017] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 21 14:48:42.884022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-809dba2c-a6ac-4d92-b4a5-87c6d9c80fd3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "DELETE /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/os-volume_attachments/a1a80b95-7c59-4d74-b941-7df47c40bb35" status: 202 len: 0 microversion: 2.20 time: 0.511012 Apr 21 14:48:42.884720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 542/1018] 10.222.0.24 () {60 vars in 1447 bytes} [Wed Apr 21 14:48:42 2021] DELETE /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/os-volume_attachments/a1a80b95-7c59-4d74-b941-7df47c40bb35 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:48:42.995693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-94862ad7-62fb-4030-8c0b-4d375c96bc4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:48:42.996322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-94862ad7-62fb-4030-8c0b-4d375c96bc4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:43.004833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94862ad7-62fb-4030-8c0b-4d375c96bc4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:43.005318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94862ad7-62fb-4030-8c0b-4d375c96bc4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:43.006469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94862ad7-62fb-4030-8c0b-4d375c96bc4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:43.007168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94862ad7-62fb-4030-8c0b-4d375c96bc4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:43.168294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-94862ad7-62fb-4030-8c0b-4d375c96bc4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action" status: 202 len: 0 microversion: 2.20 time: 0.176866 Apr 21 14:48:43.169149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 477/1019] 10.222.0.24 () {62 vars in 1309 bytes} [Wed Apr 21 14:48:42 2021] POST /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:48:43.178316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:43.179354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:43.188748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:43.189586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:43.190560 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:43.191138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:43.429647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:43.449926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:43.451626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:43.452869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-15d75ada-3503-44a0-b855-ac2cd2fe1038 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1672 microversion: 2.20 time: 0.279344 Apr 21 14:48:43.474518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 543/1020] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:43 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1672 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:44.481654 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:44.482311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:44.490919 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:44.491426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:44.492536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:44.493060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:45.238869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:45.248778 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:45.250602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:45.251741 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d12ee31a-afb2-4b29-a442-ab5b5b5bb826 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1674 microversion: 2.20 time: 0.774488 Apr 21 14:48:45.252395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 478/1021] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:44 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1674 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:46.273046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:46.273674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:46.283458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:46.284007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:46.285363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:46.285843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:46.517323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:46.527473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:46.529145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:46.530495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2e35bcc0-de4e-4074-94dc-c8c2206649ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.262520 Apr 21 14:48:46.531156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 544/1022] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:46 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:47.551388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:47.552062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:47.569054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:47.574629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:47.575554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:47.576376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:47.921750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:47.944737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:47.946799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:47.948310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-02d6fcb5-8c60-40de-a517-18b8089ece39 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.402079 Apr 21 14:48:47.948915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 479/1023] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:47 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:48.968596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:48.969201 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:48.978113 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:48.978619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:48.979459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:48.980104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:49.259519 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:49.282353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:49.288028 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:49.289920 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9a9a9f70-d760-4e58-a6d3-aa474fb72119 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.325465 Apr 21 14:48:49.292056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 545/1024] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:48 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:50.311722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:50.312389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:50.320674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:50.321644 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:50.322720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:50.323431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:50.982760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:51.002780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:51.004633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:51.005962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-603d6a32-b994-4944-9e01-329296d4f5c0 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.698425 Apr 21 14:48:51.006847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 480/1025] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:50 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:52.033861 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:52.035067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:52.048387 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:52.049511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:52.051776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:52.052713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:52.488342 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:52.507890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:52.509671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:52.510997 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-677654de-cd9a-4397-92d2-979d857a9938 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.485362 Apr 21 14:48:52.522702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 546/1026] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:52 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:53.533612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:53.535388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:53.546136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:53.547013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:53.548266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:53.548958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:53.841966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:53.854166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:53.856042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:53.858691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eec5f38e-2170-438c-be9a-60ee5bd86931 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.329629 Apr 21 14:48:53.859516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 481/1027] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:53 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:54.880586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:54.881976 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:54.890608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:54.891480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:54.892534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:54.893221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:55.366397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:55.379260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:55.381011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:55.382323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-09f2b2dc-c691-4cb8-a61c-a104eb4af6a9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.506653 Apr 21 14:48:55.383168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 547/1028] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:54 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:56.556776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:56.556776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:56.556776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:56.556776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:56.563503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:56.563503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:56.759974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:56.784397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:56.787050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:56.788932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-12d5ca23-b447-4937-a328-345a7ceadaea tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.391345 Apr 21 14:48:56.803159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 482/1029] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:56 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:57.811567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:57.812245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:57.821533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:57.822058 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:57.822875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:57.823552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:58.180388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:58.190992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:58.192830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:58.194173 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8bb236e3-bd37-4b92-84c0-d0d4ec1b6e5c tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.386936 Apr 21 14:48:58.199584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 548/1030] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:57 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:48:59.215245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:48:59.216061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:48:59.225514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:59.226180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:59.227279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:48:59.227880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:48:59.491661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:59.505216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:59.507364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:48:59.509486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e1caabf3-f94e-480f-bee1-ea464f4302e2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.298796 Apr 21 14:48:59.510101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 483/1031] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:48:59 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:00.529366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:00.530082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:00.539003 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:00.540334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:00.541532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:00.542246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:00.817227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:49:00.817475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:49:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:49:01.141960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:01.163892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:01.166571 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:01.172797 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-902ab855-3084-4668-a99f-cd1e342be1d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.643040 Apr 21 14:49:01.173931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 549/1032] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:00 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:02.195196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:02.196540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:02.211758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:02.212606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:02.213959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:02.214853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:02.515491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:02.528760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:02.530851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:02.532345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d21a8bee-c923-4e6a-a339-498cfa7a0657 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.341356 Apr 21 14:49:02.532993 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 484/1033] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:02 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:03.553891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:03.557049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:03.566270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:03.567082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:03.568743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:03.573972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:04.004359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:04.025765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:04.030046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:04.033079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1bb29847-a372-4ff8-a323-b7c49dd3d5b4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.483886 Apr 21 14:49:04.033736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 550/1034] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:03 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:05.052344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:05.052984 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:05.061430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:05.061927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:05.062934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:05.063299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:05.162022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d81e14b1-3b42-4e00-a61f-2e302a749311 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Action: 'create', calling method: .version_select at 0x7f19de7f4840>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1319973046"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:05.236385 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d81e14b1-3b42-4e00-a61f-2e302a749311 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for project 47f31a5650834e49b288140b0ca768c2. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:49:05.245192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d81e14b1-3b42-4e00-a61f-2e302a749311 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for user c134d419e09b4f7da63a8401c01bf6b3 and project 47f31a5650834e49b288140b0ca768c2. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:49:05.335531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:05.345836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:05.347558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:05.348840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-befcbfbe-1dec-44ce-8574-c01abb8d3eab tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.300967 Apr 21 14:49:05.349442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 551/1035] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:05 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:05.644103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d81e14b1-3b42-4e00-a61f-2e302a749311 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for project 47f31a5650834e49b288140b0ca768c2. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:49:05.648852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d81e14b1-3b42-4e00-a61f-2e302a749311 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for user c134d419e09b4f7da63a8401c01bf6b3 and project 47f31a5650834e49b288140b0ca768c2. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:49:05.664295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d81e14b1-3b42-4e00-a61f-2e302a749311 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.728932 Apr 21 14:49:05.665010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 485/1036] 10.222.0.24 () {60 vars in 1148 bytes} [Wed Apr 21 14:49:04 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:06.369067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:06.369849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:06.378671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:06.379536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:06.380656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:06.381403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:06.621465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:06.631972 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:06.634066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:06.636445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-547267f8-ba2f-4a8b-8e6a-4ba07bb7b7ec tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.271404 Apr 21 14:49:06.637369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 552/1037] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:06 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:07.657203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:07.658691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:07.668093 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:07.668936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:07.669769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:07.670434 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:07.906667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:07.918154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:07.919925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:07.921213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a429582b-3cd6-47b9-b697-a0b824bf8747 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.268140 Apr 21 14:49:07.921866 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 486/1038] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:07 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:08.941507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:08.942402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:08.951529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:08.952187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:08.953183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:08.953822 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:09.249573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:09.262693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:09.264977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:09.266480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4847235f-84d5-4714-846e-113766797c10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.329291 Apr 21 14:49:09.267495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 553/1039] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:08 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:09.307796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-17562992-5dba-4a24-846a-42bf5519a3da req-96a3251c-733f-4d6f-8a9e-cbfc70010782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b1c253-7437-4a43-bc08-a0626125cd82", "name": "network-vif-plugged", "status": "completed", "tag": "cc544713-b84a-4e45-b04d-b437a6b4c09b"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:09.310966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:49:09.310966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:49:09.323528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-17562992-5dba-4a24-846a-42bf5519a3da req-96a3251c-733f-4d6f-8a9e-cbfc70010782 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:09.324042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-17562992-5dba-4a24-846a-42bf5519a3da req-96a3251c-733f-4d6f-8a9e-cbfc70010782 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:09.344080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-17562992-5dba-4a24-846a-42bf5519a3da req-96a3251c-733f-4d6f-8a9e-cbfc70010782 service nova] Creating event network-vif-plugged:cc544713-b84a-4e45-b04d-b437a6b4c09b for instance 77b1c253-7437-4a43-bc08-a0626125cd82 on hv-cinder-78638 Apr 21 14:49:09.351279 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-17562992-5dba-4a24-846a-42bf5519a3da req-96a3251c-733f-4d6f-8a9e-cbfc70010782 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052258 Apr 21 14:49:09.353521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 487/1040] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:49:10.287960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:10.288898 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:10.297621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:10.298282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:10.299244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:10.300138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:10.601565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:10.618951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:10.622634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:10.625159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-05b723e8-4cb9-4559-a9ac-e70a38667aa5 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.341267 Apr 21 14:49:10.626058 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 554/1041] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:10 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:11.655573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:11.656760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:11.680567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:11.681532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:11.682899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:11.683313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:11.971760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:11.982566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:11.984590 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:11.986066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5be76c50-3233-4999-a5f6-ebde7ca60e10 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1730 microversion: 2.20 time: 0.343491 Apr 21 14:49:11.991039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 488/1042] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:11 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1730 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:13.009885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:13.010574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:13.019277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:13.019789 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:13.020648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:13.021141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:13.273384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:13.284355 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:13.286065 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:13.287353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-50c8f73f-628c-40f6-87c3-e95167bdc7c3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1717 microversion: 2.20 time: 0.281886 Apr 21 14:49:13.287997 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 555/1043] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:49:13 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1717 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:49:30.027224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-360676382", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1319973046", "security_groups": [{"name": "tempest-secgroup-smoke-222957663"}], "block_device_mapping_v2": [{"uuid": "27644a17-ae07-48e3-a2a8-ea3f15a28f03", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bf02896-5a06-4820-afef-e1d155642dab"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:30.226522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] validate_networks() for [('3bf02896-5a06-4820-afef-e1d155642dab', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:49:30.880445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:49:30.880922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:49:30.881489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:49:30.881948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:49:30.882465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:49:30.892209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:30.892718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:30.893599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:30.894124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:30.913685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for project 47f31a5650834e49b288140b0ca768c2. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:49:30.918429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for user c134d419e09b4f7da63a8401c01bf6b3 and project 47f31a5650834e49b288140b0ca768c2. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:49:31.032841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:49:31.036694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27644a17-ae07-48e3-a2a8-ea3f15a28f03',volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:49:31.228777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-28e25100-b76e-4a9b-a7b1-27e4ea0b9616 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.205742 Apr 21 14:49:31.229486 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 489/1044] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:49:30 2021] POST /compute/v2.1/servers => generated 405 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:49:31.240514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-86329f4e-16ca-46d9-948a-b075f8d54acf tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:31.241188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-86329f4e-16ca-46d9-948a-b075f8d54acf tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:31.339993 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-86329f4e-16ca-46d9-948a-b075f8d54acf tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:31.348547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-86329f4e-16ca-46d9-948a-b075f8d54acf tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1094 microversion: 2.1 time: 0.112062 Apr 21 14:49:31.349422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 556/1045] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:31 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1094 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:32.370867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7030c19e-a2bb-4d9d-b0c4-ed19ac4a14ee tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:32.371416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7030c19e-a2bb-4d9d-b0c4-ed19ac4a14ee tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:32.383884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7030c19e-a2bb-4d9d-b0c4-ed19ac4a14ee tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:32.384397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7030c19e-a2bb-4d9d-b0c4-ed19ac4a14ee tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:32.385252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7030c19e-a2bb-4d9d-b0c4-ed19ac4a14ee tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:32.385757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7030c19e-a2bb-4d9d-b0c4-ed19ac4a14ee tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:32.528453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7030c19e-a2bb-4d9d-b0c4-ed19ac4a14ee tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:32.538587 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7030c19e-a2bb-4d9d-b0c4-ed19ac4a14ee tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1200 microversion: 2.1 time: 0.174677 Apr 21 14:49:32.539407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 490/1046] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:32 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1200 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:33.557405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7b7731c4-935c-4c33-92fe-09547e52e717 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:33.558056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7b7731c4-935c-4c33-92fe-09547e52e717 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:33.566808 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b7731c4-935c-4c33-92fe-09547e52e717 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:33.567317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b7731c4-935c-4c33-92fe-09547e52e717 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:33.568143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b7731c4-935c-4c33-92fe-09547e52e717 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:33.568629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b7731c4-935c-4c33-92fe-09547e52e717 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:33.806192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7b7731c4-935c-4c33-92fe-09547e52e717 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:33.815670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7b7731c4-935c-4c33-92fe-09547e52e717 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.262400 Apr 21 14:49:33.816412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 557/1047] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:33 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:34.508974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-bcae8cb9-bcfd-405e-8ff7-3f0b424d971b req-524d384e-ece1-4617-8cde-23fa68a7d8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b886ca0-c1b7-4e12-a979-b3ddf5b77f58", "tag": "edae6881-37a1-437a-a77d-c55e80187a50"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:34.517192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:49:34.517192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:49:34.533153 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bcae8cb9-bcfd-405e-8ff7-3f0b424d971b req-524d384e-ece1-4617-8cde-23fa68a7d8ae service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:34.533648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bcae8cb9-bcfd-405e-8ff7-3f0b424d971b req-524d384e-ece1-4617-8cde-23fa68a7d8ae service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:34.552592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-bcae8cb9-bcfd-405e-8ff7-3f0b424d971b req-524d384e-ece1-4617-8cde-23fa68a7d8ae service nova] Creating event network-changed:edae6881-37a1-437a-a77d-c55e80187a50 for instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 on hv-cinder-78638 Apr 21 14:49:34.558218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-bcae8cb9-bcfd-405e-8ff7-3f0b424d971b req-524d384e-ece1-4617-8cde-23fa68a7d8ae service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054043 Apr 21 14:49:34.559156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 491/1048] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:49:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:49:34.834813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-12d18bcb-8095-48f4-af48-49db9bc067ff tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:34.835394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-12d18bcb-8095-48f4-af48-49db9bc067ff tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:34.844157 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12d18bcb-8095-48f4-af48-49db9bc067ff tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:34.844658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12d18bcb-8095-48f4-af48-49db9bc067ff tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:34.845501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12d18bcb-8095-48f4-af48-49db9bc067ff tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:34.846011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12d18bcb-8095-48f4-af48-49db9bc067ff tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:35.069827 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-12d18bcb-8095-48f4-af48-49db9bc067ff tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:35.079258 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-12d18bcb-8095-48f4-af48-49db9bc067ff tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.248863 Apr 21 14:49:35.080018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 558/1049] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:34 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:36.099404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5fa2863f-489f-40ea-91b0-bee7859e3b50 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:36.100098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5fa2863f-489f-40ea-91b0-bee7859e3b50 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:36.108902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fa2863f-489f-40ea-91b0-bee7859e3b50 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:36.109381 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fa2863f-489f-40ea-91b0-bee7859e3b50 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:36.110267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fa2863f-489f-40ea-91b0-bee7859e3b50 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:36.110754 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fa2863f-489f-40ea-91b0-bee7859e3b50 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:36.469062 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5fa2863f-489f-40ea-91b0-bee7859e3b50 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:36.478772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5fa2863f-489f-40ea-91b0-bee7859e3b50 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.384712 Apr 21 14:49:36.479303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 492/1050] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:36 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:37.498422 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-182d11ad-248e-4a5e-a4b2-e5ddf3b7b64b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:37.499134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-182d11ad-248e-4a5e-a4b2-e5ddf3b7b64b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:37.507445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-182d11ad-248e-4a5e-a4b2-e5ddf3b7b64b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:37.507949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-182d11ad-248e-4a5e-a4b2-e5ddf3b7b64b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:37.508772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-182d11ad-248e-4a5e-a4b2-e5ddf3b7b64b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:37.509262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-182d11ad-248e-4a5e-a4b2-e5ddf3b7b64b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:37.732434 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-182d11ad-248e-4a5e-a4b2-e5ddf3b7b64b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:37.742227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-182d11ad-248e-4a5e-a4b2-e5ddf3b7b64b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.248918 Apr 21 14:49:37.742912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 559/1051] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:37 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:38.763598 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fdc062cd-0133-4110-89fc-7656ea10492a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:38.764215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fdc062cd-0133-4110-89fc-7656ea10492a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:38.772693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdc062cd-0133-4110-89fc-7656ea10492a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:38.773200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdc062cd-0133-4110-89fc-7656ea10492a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:38.774079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdc062cd-0133-4110-89fc-7656ea10492a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:38.774553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdc062cd-0133-4110-89fc-7656ea10492a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:39.015243 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fdc062cd-0133-4110-89fc-7656ea10492a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:39.024534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fdc062cd-0133-4110-89fc-7656ea10492a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.266488 Apr 21 14:49:39.025211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 493/1052] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:38 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:40.044850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1e814e9e-b04e-44cc-b554-2a54b67e417d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:40.045521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1e814e9e-b04e-44cc-b554-2a54b67e417d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:40.054517 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e814e9e-b04e-44cc-b554-2a54b67e417d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:40.055115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e814e9e-b04e-44cc-b554-2a54b67e417d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:40.055951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e814e9e-b04e-44cc-b554-2a54b67e417d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:40.056427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e814e9e-b04e-44cc-b554-2a54b67e417d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:40.304000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1e814e9e-b04e-44cc-b554-2a54b67e417d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:40.315677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1e814e9e-b04e-44cc-b554-2a54b67e417d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.277496 Apr 21 14:49:40.316299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 560/1053] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:40 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:41.334102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cf392945-f495-40b3-a59a-fc0e8956cf1a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:41.334680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cf392945-f495-40b3-a59a-fc0e8956cf1a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:41.343149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf392945-f495-40b3-a59a-fc0e8956cf1a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:41.343663 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf392945-f495-40b3-a59a-fc0e8956cf1a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:41.344499 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf392945-f495-40b3-a59a-fc0e8956cf1a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:41.344997 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf392945-f495-40b3-a59a-fc0e8956cf1a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:41.565626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cf392945-f495-40b3-a59a-fc0e8956cf1a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:41.578578 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cf392945-f495-40b3-a59a-fc0e8956cf1a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.248946 Apr 21 14:49:41.579206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 494/1054] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:41 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:42.598723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5f9d9876-1633-465a-8175-16cdf0d2dcca tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:42.599529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5f9d9876-1633-465a-8175-16cdf0d2dcca tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:42.608030 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f9d9876-1633-465a-8175-16cdf0d2dcca tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:42.608544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f9d9876-1633-465a-8175-16cdf0d2dcca tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:42.609386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f9d9876-1633-465a-8175-16cdf0d2dcca tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:42.609939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f9d9876-1633-465a-8175-16cdf0d2dcca tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:42.829007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5f9d9876-1633-465a-8175-16cdf0d2dcca tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:42.838266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5f9d9876-1633-465a-8175-16cdf0d2dcca tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.243829 Apr 21 14:49:42.838908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 561/1055] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:42 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:43.856809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fb9bc2c6-94d4-44f7-a4ad-582eff257478 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:43.857392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fb9bc2c6-94d4-44f7-a4ad-582eff257478 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:43.865860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb9bc2c6-94d4-44f7-a4ad-582eff257478 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:43.866448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb9bc2c6-94d4-44f7-a4ad-582eff257478 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:43.867281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb9bc2c6-94d4-44f7-a4ad-582eff257478 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:43.867771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb9bc2c6-94d4-44f7-a4ad-582eff257478 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:44.152144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fb9bc2c6-94d4-44f7-a4ad-582eff257478 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:44.162110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fb9bc2c6-94d4-44f7-a4ad-582eff257478 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.309490 Apr 21 14:49:44.162794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 495/1056] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:43 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:44.582769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d8cd9e4c-f39c-4b61-8a72-2be0dc21d557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:44.583311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d8cd9e4c-f39c-4b61-8a72-2be0dc21d557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:44.591220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8cd9e4c-f39c-4b61-8a72-2be0dc21d557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:44.591720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8cd9e4c-f39c-4b61-8a72-2be0dc21d557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:44.592537 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8cd9e4c-f39c-4b61-8a72-2be0dc21d557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:44.593021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8cd9e4c-f39c-4b61-8a72-2be0dc21d557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:44.658622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d8cd9e4c-f39c-4b61-8a72-2be0dc21d557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:49:44.778565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d8cd9e4c-f39c-4b61-8a72-2be0dc21d557 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "DELETE /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 204 len: 0 microversion: 2.1 time: 0.199673 Apr 21 14:49:44.779425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 562/1057] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:49:44 2021] DELETE /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:49:44.788194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-525ca9d8-3a44-4a69-b62d-0b51b49483b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:44.788864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-525ca9d8-3a44-4a69-b62d-0b51b49483b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:44.796991 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-525ca9d8-3a44-4a69-b62d-0b51b49483b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:44.797504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-525ca9d8-3a44-4a69-b62d-0b51b49483b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:44.798380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-525ca9d8-3a44-4a69-b62d-0b51b49483b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:44.799043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-525ca9d8-3a44-4a69-b62d-0b51b49483b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:45.047100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-525ca9d8-3a44-4a69-b62d-0b51b49483b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:45.056737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-525ca9d8-3a44-4a69-b62d-0b51b49483b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1674 microversion: 2.1 time: 0.272660 Apr 21 14:49:45.057561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 496/1058] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:44 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1674 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:45.181313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6f44d235-d4fe-48b9-8a70-37492998a871 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:45.182198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6f44d235-d4fe-48b9-8a70-37492998a871 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:45.190349 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f44d235-d4fe-48b9-8a70-37492998a871 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:45.191001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f44d235-d4fe-48b9-8a70-37492998a871 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:45.191697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f44d235-d4fe-48b9-8a70-37492998a871 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:45.192175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f44d235-d4fe-48b9-8a70-37492998a871 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:45.431896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6f44d235-d4fe-48b9-8a70-37492998a871 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:45.443503 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6f44d235-d4fe-48b9-8a70-37492998a871 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.266973 Apr 21 14:49:45.444156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 563/1059] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:45 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:46.076437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3fbfac73-682f-487f-9102-c6c0ddc540da tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:46.077150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3fbfac73-682f-487f-9102-c6c0ddc540da tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:46.085759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fbfac73-682f-487f-9102-c6c0ddc540da tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:46.086298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fbfac73-682f-487f-9102-c6c0ddc540da tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:46.087129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fbfac73-682f-487f-9102-c6c0ddc540da tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:46.087622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fbfac73-682f-487f-9102-c6c0ddc540da tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:46.461977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-74f7c260-93df-4b9e-aae5-5685f414c059 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:46.462724 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-74f7c260-93df-4b9e-aae5-5685f414c059 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:46.465660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3fbfac73-682f-487f-9102-c6c0ddc540da tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:46.472028 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74f7c260-93df-4b9e-aae5-5685f414c059 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:46.472530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74f7c260-93df-4b9e-aae5-5685f414c059 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:46.473395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74f7c260-93df-4b9e-aae5-5685f414c059 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:46.473888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74f7c260-93df-4b9e-aae5-5685f414c059 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:46.475982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3fbfac73-682f-487f-9102-c6c0ddc540da tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1674 microversion: 2.1 time: 0.403639 Apr 21 14:49:46.476881 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 497/1060] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:46 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1674 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:46.691896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-74f7c260-93df-4b9e-aae5-5685f414c059 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:46.702390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-74f7c260-93df-4b9e-aae5-5685f414c059 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.244513 Apr 21 14:49:46.703048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 564/1061] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:46 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:47.078500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-15443bd6-b2b8-43af-84ac-07bee5a8e59f req-9eb96bf5-1e64-4c45-8fc0-7e92afc6d98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b886ca0-c1b7-4e12-a979-b3ddf5b77f58", "name": "network-vif-plugged", "status": "completed", "tag": "edae6881-37a1-437a-a77d-c55e80187a50"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:47.080488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:49:47.080488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:49:47.090135 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-15443bd6-b2b8-43af-84ac-07bee5a8e59f req-9eb96bf5-1e64-4c45-8fc0-7e92afc6d98d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:47.091086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-15443bd6-b2b8-43af-84ac-07bee5a8e59f req-9eb96bf5-1e64-4c45-8fc0-7e92afc6d98d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:47.109647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-15443bd6-b2b8-43af-84ac-07bee5a8e59f req-9eb96bf5-1e64-4c45-8fc0-7e92afc6d98d service nova] Creating event network-vif-plugged:edae6881-37a1-437a-a77d-c55e80187a50 for instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 on hv-cinder-78638 Apr 21 14:49:47.115836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-15443bd6-b2b8-43af-84ac-07bee5a8e59f req-9eb96bf5-1e64-4c45-8fc0-7e92afc6d98d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041507 Apr 21 14:49:47.116691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 498/1062] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:49:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:49:47.494288 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a4bceef-f677-4fe6-89b1-77e834485bf2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:47.495054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a4bceef-f677-4fe6-89b1-77e834485bf2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:47.503987 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a4bceef-f677-4fe6-89b1-77e834485bf2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:47.504496 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a4bceef-f677-4fe6-89b1-77e834485bf2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:47.505352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a4bceef-f677-4fe6-89b1-77e834485bf2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:47.505848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a4bceef-f677-4fe6-89b1-77e834485bf2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:47.644977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3a4bceef-f677-4fe6-89b1-77e834485bf2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:47.656061 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a4bceef-f677-4fe6-89b1-77e834485bf2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1606 microversion: 2.1 time: 0.165898 Apr 21 14:49:47.657075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 565/1063] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:47 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1606 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:47.720948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4ee41e35-8348-4eed-9dc6-9ee1be223a6e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:47.721640 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4ee41e35-8348-4eed-9dc6-9ee1be223a6e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:47.730583 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ee41e35-8348-4eed-9dc6-9ee1be223a6e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:47.731292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ee41e35-8348-4eed-9dc6-9ee1be223a6e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:47.732161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ee41e35-8348-4eed-9dc6-9ee1be223a6e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:47.732663 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ee41e35-8348-4eed-9dc6-9ee1be223a6e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:48.201476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-dbb99ec6-30f8-4c32-b49b-7ef2df22b8d4 req-b3b02bb3-bbce-422b-99c4-fe7d83e64d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0ca663-e263-49ed-b0c6-874b504da2e3", "name": "network-vif-deleted", "tag": "bfdb3723-3356-4b82-8547-cade024b7b10"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:48.203575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:49:48.203575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:49:48.213697 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-dbb99ec6-30f8-4c32-b49b-7ef2df22b8d4 req-b3b02bb3-bbce-422b-99c4-fe7d83e64d5d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:48.214971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-dbb99ec6-30f8-4c32-b49b-7ef2df22b8d4 req-b3b02bb3-bbce-422b-99c4-fe7d83e64d5d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:48.229285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4ee41e35-8348-4eed-9dc6-9ee1be223a6e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:48.240149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4ee41e35-8348-4eed-9dc6-9ee1be223a6e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1265 microversion: 2.1 time: 0.523827 Apr 21 14:49:48.241089 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 499/1064] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:47 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1265 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:48.251148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-dbb99ec6-30f8-4c32-b49b-7ef2df22b8d4 req-b3b02bb3-bbce-422b-99c4-fe7d83e64d5d service nova] Creating event network-vif-deleted:bfdb3723-3356-4b82-8547-cade024b7b10 for instance eb0ca663-e263-49ed-b0c6-874b504da2e3 on hv-cinder-78638 Apr 21 14:49:48.255424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-dbb99ec6-30f8-4c32-b49b-7ef2df22b8d4 req-b3b02bb3-bbce-422b-99c4-fe7d83e64d5d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057629 Apr 21 14:49:48.256207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 566/1065] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:49:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:49:48.675857 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:48.676531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:48.685158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:48.685713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:48.693382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:48.693880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:48.772232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:48.772740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:48.773245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lazy-loading 'fault' on Instance uuid eb0ca663-e263-49ed-b0c6-874b504da2e3 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:49:48.857546 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:48.868581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ca45bf72-bdcb-47d7-a9ac-4ce92caaa49b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 200 len: 1327 microversion: 2.1 time: 0.197249 Apr 21 14:49:48.869948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 500/1066] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:48 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 1327 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:49.263328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b867e837-2aa1-4db1-badb-5027d56122f3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:49.264455 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b867e837-2aa1-4db1-badb-5027d56122f3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:49.273204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b867e837-2aa1-4db1-badb-5027d56122f3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:49.273710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b867e837-2aa1-4db1-badb-5027d56122f3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:49.274564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b867e837-2aa1-4db1-badb-5027d56122f3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:49.275049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b867e837-2aa1-4db1-badb-5027d56122f3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:49.493129 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b867e837-2aa1-4db1-badb-5027d56122f3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:49.503354 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b867e837-2aa1-4db1-badb-5027d56122f3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1452 microversion: 2.1 time: 0.248024 Apr 21 14:49:49.503996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 567/1067] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:49 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1452 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:49.521815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-24dedd2d-c304-4792-bf7b-888ed6867c2a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:49.522526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-24dedd2d-c304-4792-bf7b-888ed6867c2a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:49.530924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24dedd2d-c304-4792-bf7b-888ed6867c2a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:49.531438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24dedd2d-c304-4792-bf7b-888ed6867c2a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:49.532278 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24dedd2d-c304-4792-bf7b-888ed6867c2a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:49.532775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24dedd2d-c304-4792-bf7b-888ed6867c2a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:49.759718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-24dedd2d-c304-4792-bf7b-888ed6867c2a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:49.769010 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-24dedd2d-c304-4792-bf7b-888ed6867c2a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1452 microversion: 2.1 time: 0.251985 Apr 21 14:49:49.769679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 501/1068] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:49 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1452 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:49.887200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab07260c-9ad9-483c-9869-b28a83b4dc6d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:49.887766 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ab07260c-9ad9-483c-9869-b28a83b4dc6d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:49.904924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab07260c-9ad9-483c-9869-b28a83b4dc6d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:49.905474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab07260c-9ad9-483c-9869-b28a83b4dc6d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:49.906394 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab07260c-9ad9-483c-9869-b28a83b4dc6d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:49.907022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab07260c-9ad9-483c-9869-b28a83b4dc6d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:49.962237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-ab07260c-9ad9-483c-9869-b28a83b4dc6d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] HTTP exception thrown: Instance eb0ca663-e263-49ed-b0c6-874b504da2e3 could not be found. Apr 21 14:49:49.962949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab07260c-9ad9-483c-9869-b28a83b4dc6d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Returning 404 to user: Instance eb0ca663-e263-49ed-b0c6-874b504da2e3 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:49:49.964345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ab07260c-9ad9-483c-9869-b28a83b4dc6d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 404 len: 111 microversion: 2.1 time: 0.080977 Apr 21 14:49:49.965038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 568/1069] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:49 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:49:49.973826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4d94cc99-7e48-4da1-af76-fe4fb700b46a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '.version_select at 0x7f19de8a3e18>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:49.992878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4d94cc99-7e48-4da1-af76-fe4fb700b46a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595400904" status: 202 len: 0 microversion: 2.1 time: 0.023305 Apr 21 14:49:49.993722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 502/1070] 10.222.0.24 () {58 vars in 1208 bytes} [Wed Apr 21 14:49:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595400904 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:49:51.403254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4b1b7a41-0492-454b-a091-30cb63438f80 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'create', calling method: .version_select at 0x7f19df311510>, body: {"keypair": {"name": "tempest-keypair-604140834"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:51.427690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4b1b7a41-0492-454b-a091-30cb63438f80 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for project 2023f43db8e84313ace24e0426447810. Resources: {'key_pairs'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:49:51.432038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4b1b7a41-0492-454b-a091-30cb63438f80 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for user 9ff00d9db5164c7e9c38bdace0cb94ba and project 2023f43db8e84313ace24e0426447810. Resources: {'key_pairs'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:49:51.658856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4b1b7a41-0492-454b-a091-30cb63438f80 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for project 2023f43db8e84313ace24e0426447810. Resources: {'key_pairs'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:49:51.663154 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4b1b7a41-0492-454b-a091-30cb63438f80 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for user 9ff00d9db5164c7e9c38bdace0cb94ba and project 2023f43db8e84313ace24e0426447810. Resources: {'key_pairs'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:49:51.678254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4b1b7a41-0492-454b-a091-30cb63438f80 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.279042 Apr 21 14:49:51.678926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 569/1071] 10.222.0.24 () {60 vars in 1148 bytes} [Wed Apr 21 14:49:51 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:52.660019 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-91efa34a-ed51-482f-b93d-2b3d61be3227 req-f82fd826-055e-4ee6-a072-566aa2b1a3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b886ca0-c1b7-4e12-a979-b3ddf5b77f58", "tag": "edae6881-37a1-437a-a77d-c55e80187a50"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:52.662794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:49:52.662794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:49:52.672603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-91efa34a-ed51-482f-b93d-2b3d61be3227 req-f82fd826-055e-4ee6-a072-566aa2b1a3c7 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:52.673198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-91efa34a-ed51-482f-b93d-2b3d61be3227 req-f82fd826-055e-4ee6-a072-566aa2b1a3c7 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:52.692412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-91efa34a-ed51-482f-b93d-2b3d61be3227 req-f82fd826-055e-4ee6-a072-566aa2b1a3c7 service nova] Creating event network-changed:edae6881-37a1-437a-a77d-c55e80187a50 for instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 on hv-cinder-78638 Apr 21 14:49:52.699623 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-91efa34a-ed51-482f-b93d-2b3d61be3227 req-f82fd826-055e-4ee6-a072-566aa2b1a3c7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044330 Apr 21 14:49:52.700787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 503/1072] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:49:53.533642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2133864180", "imageRef": "e26a23f0-26a9-4df8-9f60-baafffec83cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a53d39c-de06-4bc6-9033-7145f2f15e49"}], "security_groups": [{"name": "tempest-securitygroup--1925365346"}], "key_name": "tempest-keypair-604140834", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:53.675584 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] validate_networks() for [('6a53d39c-de06-4bc6-9033-7145f2f15e49', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:49:54.353813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:49:54.354320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:49:54.354864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:49:54.355325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:49:54.355794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:49:54.365426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:54.366140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:54.367023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:54.367588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:54.387501 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for project 2023f43db8e84313ace24e0426447810. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:49:54.391921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Getting quotas for user 9ff00d9db5164c7e9c38bdace0cb94ba and project 2023f43db8e84313ace24e0426447810. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:49:54.403641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:49:54.406366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e26a23f0-26a9-4df8-9f60-baafffec83cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:49:54.460819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8aa4dbc6-92ae-4b3e-bdb4-54a4ae389c48 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.931641 Apr 21 14:49:54.461424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 570/1073] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:49:53 2021] POST /compute/v2.1/servers => generated 402 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:49:54.473117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fa2ccb0a-6576-4ceb-b33a-52890da19707 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:54.473891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fa2ccb0a-6576-4ceb-b33a-52890da19707 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:54.559849 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fa2ccb0a-6576-4ceb-b33a-52890da19707 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:54.569027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fa2ccb0a-6576-4ceb-b33a-52890da19707 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1237 microversion: 2.1 time: 0.100415 Apr 21 14:49:54.569572 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 504/1074] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:54 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:55.591530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-28e336a9-48b7-4cd4-a5ac-6f11103cc275 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:55.592269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-28e336a9-48b7-4cd4-a5ac-6f11103cc275 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:55.603034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28e336a9-48b7-4cd4-a5ac-6f11103cc275 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:55.603864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28e336a9-48b7-4cd4-a5ac-6f11103cc275 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:55.605127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28e336a9-48b7-4cd4-a5ac-6f11103cc275 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:55.605968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28e336a9-48b7-4cd4-a5ac-6f11103cc275 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:55.746135 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-28e336a9-48b7-4cd4-a5ac-6f11103cc275 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:55.755629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-28e336a9-48b7-4cd4-a5ac-6f11103cc275 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1297 microversion: 2.1 time: 0.171025 Apr 21 14:49:55.756378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 571/1075] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:55 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1297 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:56.774924 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8c6505c8-092f-4d6e-8a23-a7f837482b9d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:56.776250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8c6505c8-092f-4d6e-8a23-a7f837482b9d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:56.785538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c6505c8-092f-4d6e-8a23-a7f837482b9d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:56.786067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c6505c8-092f-4d6e-8a23-a7f837482b9d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:56.786954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c6505c8-092f-4d6e-8a23-a7f837482b9d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:56.787392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c6505c8-092f-4d6e-8a23-a7f837482b9d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:57.259644 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8c6505c8-092f-4d6e-8a23-a7f837482b9d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:57.269691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8c6505c8-092f-4d6e-8a23-a7f837482b9d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1363 microversion: 2.1 time: 0.498777 Apr 21 14:49:57.270606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 505/1076] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:56 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1363 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:57.772823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-928ebc43-eab0-4b43-8af0-3d48513fe1d7 req-6a9282f3-f751-43ab-91c2-88bcc006f779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e0a0a8-1304-45b9-9f97-c2b4dea75e73", "tag": "6d317d01-4d38-41ae-a496-0f075551f3b8"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:49:57.775704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:49:57.775704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:49:57.798270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-928ebc43-eab0-4b43-8af0-3d48513fe1d7 req-6a9282f3-f751-43ab-91c2-88bcc006f779 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:57.798890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-928ebc43-eab0-4b43-8af0-3d48513fe1d7 req-6a9282f3-f751-43ab-91c2-88bcc006f779 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:57.818103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-928ebc43-eab0-4b43-8af0-3d48513fe1d7 req-6a9282f3-f751-43ab-91c2-88bcc006f779 service nova] Creating event network-changed:6d317d01-4d38-41ae-a496-0f075551f3b8 for instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 on hv-cinder-78638 Apr 21 14:49:57.824150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-928ebc43-eab0-4b43-8af0-3d48513fe1d7 req-6a9282f3-f751-43ab-91c2-88bcc006f779 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055196 Apr 21 14:49:57.825468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 572/1077] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:49:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:49:58.289079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b04aea6-e4eb-40e2-8273-516e39cd451f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:58.289750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b04aea6-e4eb-40e2-8273-516e39cd451f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:58.298150 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b04aea6-e4eb-40e2-8273-516e39cd451f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:58.298652 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b04aea6-e4eb-40e2-8273-516e39cd451f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:58.299478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b04aea6-e4eb-40e2-8273-516e39cd451f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:58.300309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b04aea6-e4eb-40e2-8273-516e39cd451f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:58.753074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1b04aea6-e4eb-40e2-8273-516e39cd451f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:49:58.763284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b04aea6-e4eb-40e2-8273-516e39cd451f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1363 microversion: 2.1 time: 0.478695 Apr 21 14:49:58.763957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 506/1078] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:58 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1363 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:49:59.782705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d680ee7e-3f19-4295-8f74-79b307bb9b4a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:49:59.783498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d680ee7e-3f19-4295-8f74-79b307bb9b4a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:49:59.792156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d680ee7e-3f19-4295-8f74-79b307bb9b4a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:59.792668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d680ee7e-3f19-4295-8f74-79b307bb9b4a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:49:59.793505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d680ee7e-3f19-4295-8f74-79b307bb9b4a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:49:59.794074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d680ee7e-3f19-4295-8f74-79b307bb9b4a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:00.026226 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d680ee7e-3f19-4295-8f74-79b307bb9b4a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:00.049519 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d680ee7e-3f19-4295-8f74-79b307bb9b4a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1363 microversion: 2.1 time: 0.271159 Apr 21 14:50:00.051054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 573/1079] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:49:59 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:50:01.078787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9ce61cfa-93d8-4311-a417-1a71b8acaf08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:01.079575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9ce61cfa-93d8-4311-a417-1a71b8acaf08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:01.087937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ce61cfa-93d8-4311-a417-1a71b8acaf08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:01.088441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ce61cfa-93d8-4311-a417-1a71b8acaf08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:01.089266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ce61cfa-93d8-4311-a417-1a71b8acaf08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:01.089752 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ce61cfa-93d8-4311-a417-1a71b8acaf08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:01.321025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9ce61cfa-93d8-4311-a417-1a71b8acaf08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:01.334039 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9ce61cfa-93d8-4311-a417-1a71b8acaf08 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1363 microversion: 2.1 time: 0.259212 Apr 21 14:50:01.334699 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 507/1080] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:50:01 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:50:02.354818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e0eaa3a-910a-487b-9330-50a25e23806f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:02.355389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e0eaa3a-910a-487b-9330-50a25e23806f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:02.364198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e0eaa3a-910a-487b-9330-50a25e23806f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:02.364679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e0eaa3a-910a-487b-9330-50a25e23806f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:02.365542 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e0eaa3a-910a-487b-9330-50a25e23806f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:02.366050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e0eaa3a-910a-487b-9330-50a25e23806f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:02.595603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8e0eaa3a-910a-487b-9330-50a25e23806f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:02.606146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e0eaa3a-910a-487b-9330-50a25e23806f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1363 microversion: 2.1 time: 0.255344 Apr 21 14:50:02.606726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 574/1081] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:50:02 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:50:03.624877 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ea3a8cd8-b29b-4a5c-abe2-9c3e66773687 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:03.625549 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ea3a8cd8-b29b-4a5c-abe2-9c3e66773687 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:03.633980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea3a8cd8-b29b-4a5c-abe2-9c3e66773687 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:03.634534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea3a8cd8-b29b-4a5c-abe2-9c3e66773687 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:03.635382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea3a8cd8-b29b-4a5c-abe2-9c3e66773687 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:03.635874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ea3a8cd8-b29b-4a5c-abe2-9c3e66773687 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:03.873944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ea3a8cd8-b29b-4a5c-abe2-9c3e66773687 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:03.884015 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ea3a8cd8-b29b-4a5c-abe2-9c3e66773687 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1363 microversion: 2.1 time: 0.263191 Apr 21 14:50:03.884696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 508/1082] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:50:03 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:50:04.904416 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-75ddba51-b4e6-4f66-9afc-d159d65d6ecb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:04.905139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-75ddba51-b4e6-4f66-9afc-d159d65d6ecb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:04.913978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75ddba51-b4e6-4f66-9afc-d159d65d6ecb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:04.914543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75ddba51-b4e6-4f66-9afc-d159d65d6ecb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:04.915510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75ddba51-b4e6-4f66-9afc-d159d65d6ecb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:04.916162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75ddba51-b4e6-4f66-9afc-d159d65d6ecb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:05.161789 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-75ddba51-b4e6-4f66-9afc-d159d65d6ecb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:05.171025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-75ddba51-b4e6-4f66-9afc-d159d65d6ecb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1363 microversion: 2.1 time: 0.271167 Apr 21 14:50:05.171648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 575/1083] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:50:04 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:50:05.239997 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-f11119b2-49dd-4923-a769-4f60702c5820 req-ef515729-bb6e-413a-b508-8e29c9d3c3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e0a0a8-1304-45b9-9f97-c2b4dea75e73", "name": "network-vif-plugged", "status": "completed", "tag": "6d317d01-4d38-41ae-a496-0f075551f3b8"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:05.241867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:50:05.241867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:50:05.251050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f11119b2-49dd-4923-a769-4f60702c5820 req-ef515729-bb6e-413a-b508-8e29c9d3c3a3 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:05.251545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f11119b2-49dd-4923-a769-4f60702c5820 req-ef515729-bb6e-413a-b508-8e29c9d3c3a3 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:05.269046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-f11119b2-49dd-4923-a769-4f60702c5820 req-ef515729-bb6e-413a-b508-8e29c9d3c3a3 service nova] Creating event network-vif-plugged:6d317d01-4d38-41ae-a496-0f075551f3b8 for instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 on hv-cinder-78638 Apr 21 14:50:05.274225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-f11119b2-49dd-4923-a769-4f60702c5820 req-ef515729-bb6e-413a-b508-8e29c9d3c3a3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038342 Apr 21 14:50:05.274851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 509/1084] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:50:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:50:06.189657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-79dabdd8-adc2-499d-9941-5ee4105bbfcc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:06.190319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-79dabdd8-adc2-499d-9941-5ee4105bbfcc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:06.198863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79dabdd8-adc2-499d-9941-5ee4105bbfcc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:06.199373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79dabdd8-adc2-499d-9941-5ee4105bbfcc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:06.200219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79dabdd8-adc2-499d-9941-5ee4105bbfcc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:06.200706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79dabdd8-adc2-499d-9941-5ee4105bbfcc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:06.424459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79dabdd8-adc2-499d-9941-5ee4105bbfcc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:06.434283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-79dabdd8-adc2-499d-9941-5ee4105bbfcc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1363 microversion: 2.1 time: 0.248855 Apr 21 14:50:06.434965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 576/1085] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:50:06 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:50:07.456250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f09202c1-d56b-4dfb-a0b1-b72932f8ac7e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:07.457168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f09202c1-d56b-4dfb-a0b1-b72932f8ac7e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:07.466349 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f09202c1-d56b-4dfb-a0b1-b72932f8ac7e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:07.466846 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f09202c1-d56b-4dfb-a0b1-b72932f8ac7e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:07.467714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f09202c1-d56b-4dfb-a0b1-b72932f8ac7e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:07.468202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f09202c1-d56b-4dfb-a0b1-b72932f8ac7e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:07.694345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f09202c1-d56b-4dfb-a0b1-b72932f8ac7e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:07.704167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f09202c1-d56b-4dfb-a0b1-b72932f8ac7e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1549 microversion: 2.1 time: 0.254195 Apr 21 14:50:07.704803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 510/1086] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:50:07 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1549 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:50:07.722047 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ef444614-7316-4fee-aa1d-2a9c7f468954 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:07.722507 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ef444614-7316-4fee-aa1d-2a9c7f468954 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:07.730733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef444614-7316-4fee-aa1d-2a9c7f468954 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:07.731234 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef444614-7316-4fee-aa1d-2a9c7f468954 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:07.732075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef444614-7316-4fee-aa1d-2a9c7f468954 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:07.732569 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef444614-7316-4fee-aa1d-2a9c7f468954 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:07.898863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ef444614-7316-4fee-aa1d-2a9c7f468954 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180872 Apr 21 14:50:07.899739 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 577/1087] 10.222.0.24 () {58 vars in 1265 bytes} [Wed Apr 21 14:50:07 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:50:10.033737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7b13ba20-fe6b-4ccd-8501-a4ab090383a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:10.034880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7b13ba20-fe6b-4ccd-8501-a4ab090383a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:10.036075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-d2a19e09-93a9-4671-867a-856b4d0d88ee req-05d95655-7959-41d7-853a-30ef61b0e13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e0a0a8-1304-45b9-9f97-c2b4dea75e73", "tag": "6d317d01-4d38-41ae-a496-0f075551f3b8"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:10.039328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:50:10.039328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:50:10.051437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d2a19e09-93a9-4671-867a-856b4d0d88ee req-05d95655-7959-41d7-853a-30ef61b0e13b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:10.051947 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d2a19e09-93a9-4671-867a-856b4d0d88ee req-05d95655-7959-41d7-853a-30ef61b0e13b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:10.054160 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b13ba20-fe6b-4ccd-8501-a4ab090383a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:10.054767 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b13ba20-fe6b-4ccd-8501-a4ab090383a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:10.055621 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b13ba20-fe6b-4ccd-8501-a4ab090383a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:10.056139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b13ba20-fe6b-4ccd-8501-a4ab090383a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:10.074281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-d2a19e09-93a9-4671-867a-856b4d0d88ee req-05d95655-7959-41d7-853a-30ef61b0e13b service nova] Creating event network-changed:6d317d01-4d38-41ae-a496-0f075551f3b8 for instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 on hv-cinder-78638 Apr 21 14:50:10.080182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-d2a19e09-93a9-4671-867a-856b4d0d88ee req-05d95655-7959-41d7-853a-30ef61b0e13b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048595 Apr 21 14:50:10.081197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 578/1088] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:50:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:50:10.201894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7b13ba20-fe6b-4ccd-8501-a4ab090383a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.171922 Apr 21 14:50:10.202502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 511/1089] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:10 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:11.214552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-79d5eeca-153b-4a31-b879-a173810aeea2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:11.215714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-79d5eeca-153b-4a31-b879-a173810aeea2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:11.224830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79d5eeca-153b-4a31-b879-a173810aeea2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:11.225336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79d5eeca-153b-4a31-b879-a173810aeea2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:11.226209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79d5eeca-153b-4a31-b879-a173810aeea2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:11.226698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79d5eeca-153b-4a31-b879-a173810aeea2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:11.329438 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-79d5eeca-153b-4a31-b879-a173810aeea2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.119448 Apr 21 14:50:11.330172 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 579/1090] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:11 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:12.342461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-54a2c755-c3e6-4cb9-9699-3ec3a6c78f59 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:12.343775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-54a2c755-c3e6-4cb9-9699-3ec3a6c78f59 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:12.353196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54a2c755-c3e6-4cb9-9699-3ec3a6c78f59 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:12.353823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54a2c755-c3e6-4cb9-9699-3ec3a6c78f59 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:12.354706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54a2c755-c3e6-4cb9-9699-3ec3a6c78f59 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:12.355216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54a2c755-c3e6-4cb9-9699-3ec3a6c78f59 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:12.420137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-969a682b-ed52-49ac-842c-ae28f4c83716 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:12.420793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-969a682b-ed52-49ac-842c-ae28f4c83716 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:12.430321 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-969a682b-ed52-49ac-842c-ae28f4c83716 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:12.430828 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-969a682b-ed52-49ac-842c-ae28f4c83716 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:12.431679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-969a682b-ed52-49ac-842c-ae28f4c83716 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:12.432218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-969a682b-ed52-49ac-842c-ae28f4c83716 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:12.463948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-54a2c755-c3e6-4cb9-9699-3ec3a6c78f59 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.125746 Apr 21 14:50:12.464872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 512/1091] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:12 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:12.499408 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-969a682b-ed52-49ac-842c-ae28f4c83716 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:50:12.623735 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-969a682b-ed52-49ac-842c-ae28f4c83716 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "DELETE /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 204 len: 0 microversion: 2.20 time: 0.207798 Apr 21 14:50:12.624420 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 580/1092] 10.222.0.24 () {60 vars in 1270 bytes} [Wed Apr 21 14:50:12 2021] DELETE /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:50:12.634988 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:12.635729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:12.644662 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:12.645167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:12.646031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:12.646523 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:12.878793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:12.888996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:12.890695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:12.891934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2124db96-979a-4198-99d0-a41f772e58c9 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.261599 Apr 21 14:50:12.892562 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 513/1093] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:50:12 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:50:13.478228 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb1f65a0-a15f-4064-a87e-e65329fd7db5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:13.479391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb1f65a0-a15f-4064-a87e-e65329fd7db5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:13.492481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb1f65a0-a15f-4064-a87e-e65329fd7db5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:13.492998 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb1f65a0-a15f-4064-a87e-e65329fd7db5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:13.493847 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb1f65a0-a15f-4064-a87e-e65329fd7db5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:13.494379 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb1f65a0-a15f-4064-a87e-e65329fd7db5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:13.597448 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb1f65a0-a15f-4064-a87e-e65329fd7db5 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.124117 Apr 21 14:50:13.598204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 581/1094] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:13 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:13.912423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:13.913074 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:13.921949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:13.922592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:13.923421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:13.923906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:14.153829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:14.164335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:14.166016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:14.167334 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c2179af0-5a52-4e5c-b96a-c56a6f290868 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.259191 Apr 21 14:50:14.168223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 514/1095] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:50:13 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:50:14.610774 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1093bb09-18ac-4f12-8157-f0026f0d8783 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:14.611854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1093bb09-18ac-4f12-8157-f0026f0d8783 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:14.620886 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1093bb09-18ac-4f12-8157-f0026f0d8783 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:14.621339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1093bb09-18ac-4f12-8157-f0026f0d8783 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:14.622237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1093bb09-18ac-4f12-8157-f0026f0d8783 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:14.622818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1093bb09-18ac-4f12-8157-f0026f0d8783 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:14.723476 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1093bb09-18ac-4f12-8157-f0026f0d8783 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.117158 Apr 21 14:50:14.724172 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 582/1096] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:14 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:15.188190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:15.188889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:15.197044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:15.197524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:15.198498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:15.198872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:15.606339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:15.616386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:15.618155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:15.619407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9a847f62-5ce3-422b-a8c9-78f2e24157d1 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1723 microversion: 2.20 time: 0.435470 Apr 21 14:50:15.620063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 515/1097] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:50:15 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:50:15.736516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0e6b67c5-fa6d-448d-9b43-b1ac03fd6f01 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:15.737764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0e6b67c5-fa6d-448d-9b43-b1ac03fd6f01 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:15.747070 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e6b67c5-fa6d-448d-9b43-b1ac03fd6f01 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:15.747556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e6b67c5-fa6d-448d-9b43-b1ac03fd6f01 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:15.748402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e6b67c5-fa6d-448d-9b43-b1ac03fd6f01 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:15.748915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e6b67c5-fa6d-448d-9b43-b1ac03fd6f01 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:15.849383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0e6b67c5-fa6d-448d-9b43-b1ac03fd6f01 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.117275 Apr 21 14:50:15.850158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 583/1098] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:15 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:16.536216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-c9787819-d947-4bfe-934d-e8fa34bf3989 req-d544effc-9297-46f9-b9e3-b73cd1a52163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b1c253-7437-4a43-bc08-a0626125cd82", "name": "network-vif-deleted", "tag": "cc544713-b84a-4e45-b04d-b437a6b4c09b"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:16.539958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:50:16.539958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:50:16.558759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c9787819-d947-4bfe-934d-e8fa34bf3989 req-d544effc-9297-46f9-b9e3-b73cd1a52163 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:16.559736 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c9787819-d947-4bfe-934d-e8fa34bf3989 req-d544effc-9297-46f9-b9e3-b73cd1a52163 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:16.597803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-c9787819-d947-4bfe-934d-e8fa34bf3989 req-d544effc-9297-46f9-b9e3-b73cd1a52163 service nova] Creating event network-vif-deleted:cc544713-b84a-4e45-b04d-b437a6b4c09b for instance 77b1c253-7437-4a43-bc08-a0626125cd82 on hv-cinder-78638 Apr 21 14:50:16.608028 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-c9787819-d947-4bfe-934d-e8fa34bf3989 req-d544effc-9297-46f9-b9e3-b73cd1a52163 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160862 Apr 21 14:50:16.609080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 516/1099] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:50:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:50:16.641236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:16.642020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:16.663080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:16.663939 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:16.665293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:16.666231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:16.750685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:16.751266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:16.751805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lazy-loading 'fault' on Instance uuid 77b1c253-7437-4a43-bc08-a0626125cd82 {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:50:16.824904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:16.835187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:16.836865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff12725509264be384462a84ea6aaf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0771cc9ab3c4a23881ef55e4b3218b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:50:16.838161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5c088533-2bf9-4601-9b3e-a0aaa5999c4a tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 200 len: 1370 microversion: 2.20 time: 0.201669 Apr 21 14:50:16.838787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 584/1100] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:50:16 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:50:16.862547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b4db602e-025a-42f1-88ca-99746d1537d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:16.863642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b4db602e-025a-42f1-88ca-99746d1537d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:16.872275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4db602e-025a-42f1-88ca-99746d1537d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:16.872746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4db602e-025a-42f1-88ca-99746d1537d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:16.873597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4db602e-025a-42f1-88ca-99746d1537d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:16.874079 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4db602e-025a-42f1-88ca-99746d1537d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:16.982431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b4db602e-025a-42f1-88ca-99746d1537d2 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.124518 Apr 21 14:50:16.983231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 517/1101] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:16 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:17.858471 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-801c703a-4345-4274-b683-5f807b9ec309 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:17.859192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-801c703a-4345-4274-b683-5f807b9ec309 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:17.867681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-801c703a-4345-4274-b683-5f807b9ec309 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:17.868192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-801c703a-4345-4274-b683-5f807b9ec309 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:17.869048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-801c703a-4345-4274-b683-5f807b9ec309 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:17.869543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-801c703a-4345-4274-b683-5f807b9ec309 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:17.924222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-801c703a-4345-4274-b683-5f807b9ec309 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] HTTP exception thrown: Instance 77b1c253-7437-4a43-bc08-a0626125cd82 could not be found. Apr 21 14:50:17.925265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-801c703a-4345-4274-b683-5f807b9ec309 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Returning 404 to user: Instance 77b1c253-7437-4a43-bc08-a0626125cd82 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:50:17.926216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-801c703a-4345-4274-b683-5f807b9ec309 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 404 len: 111 microversion: 2.20 time: 0.072099 Apr 21 14:50:17.926922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 585/1102] 10.222.0.24 () {60 vars in 1267 bytes} [Wed Apr 21 14:50:17 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:50:17.936852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f0e27d7-9769-4e1f-b0b5-0ab36307c1a2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '.version_select at 0x7f19dea2c598>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:17.959194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f0e27d7-9769-4e1f-b0b5-0ab36307c1a2 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-581730087" status: 204 len: 0 microversion: 2.20 time: 0.026368 Apr 21 14:50:17.960551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 518/1103] 10.222.0.24 () {60 vars in 1249 bytes} [Wed Apr 21 14:50:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-581730087 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:50:17.995432 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1740e298-3f3d-436e-adc2-4c1fc3abeb53 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:17.996484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1740e298-3f3d-436e-adc2-4c1fc3abeb53 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:18.005248 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1740e298-3f3d-436e-adc2-4c1fc3abeb53 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:18.005768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1740e298-3f3d-436e-adc2-4c1fc3abeb53 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:18.006641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1740e298-3f3d-436e-adc2-4c1fc3abeb53 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:18.007322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1740e298-3f3d-436e-adc2-4c1fc3abeb53 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:18.111028 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1740e298-3f3d-436e-adc2-4c1fc3abeb53 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.119595 Apr 21 14:50:18.114932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 586/1104] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:17 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:19.124317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-30293609-6993-4a75-9b63-c349257b410a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:19.125642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-30293609-6993-4a75-9b63-c349257b410a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:19.135768 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30293609-6993-4a75-9b63-c349257b410a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:19.136362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30293609-6993-4a75-9b63-c349257b410a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:19.137127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30293609-6993-4a75-9b63-c349257b410a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:19.137607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30293609-6993-4a75-9b63-c349257b410a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:19.245545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-30293609-6993-4a75-9b63-c349257b410a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.125925 Apr 21 14:50:19.246668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 519/1105] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:19 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:20.259017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-370096df-3224-4172-8a03-23dcc05a2a35 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:20.260176 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-370096df-3224-4172-8a03-23dcc05a2a35 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:20.269313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-370096df-3224-4172-8a03-23dcc05a2a35 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:20.269823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-370096df-3224-4172-8a03-23dcc05a2a35 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:20.270696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-370096df-3224-4172-8a03-23dcc05a2a35 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:20.271186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-370096df-3224-4172-8a03-23dcc05a2a35 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:20.381733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-370096df-3224-4172-8a03-23dcc05a2a35 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 14 microversion: 2.1 time: 0.127172 Apr 21 14:50:20.382498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 587/1106] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:20 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:50:20.736722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c896b6c8-988a-4bdd-93e8-5b8b3a99e8d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:20.737537 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c896b6c8-988a-4bdd-93e8-5b8b3a99e8d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:20.749525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c896b6c8-988a-4bdd-93e8-5b8b3a99e8d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:20.750425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c896b6c8-988a-4bdd-93e8-5b8b3a99e8d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:20.751715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c896b6c8-988a-4bdd-93e8-5b8b3a99e8d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:20.752544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c896b6c8-988a-4bdd-93e8-5b8b3a99e8d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:20.806345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-c896b6c8-988a-4bdd-93e8-5b8b3a99e8d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] HTTP exception thrown: Instance 77b1c253-7437-4a43-bc08-a0626125cd82 could not be found. Apr 21 14:50:20.807046 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c896b6c8-988a-4bdd-93e8-5b8b3a99e8d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Returning 404 to user: Instance 77b1c253-7437-4a43-bc08-a0626125cd82 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:50:20.807930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c896b6c8-988a-4bdd-93e8-5b8b3a99e8d3 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "DELETE /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 404 len: 111 microversion: 2.1 time: 0.075968 Apr 21 14:50:20.808564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 520/1107] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:50:20 2021] DELETE /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:50:20.818363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44b921f3-9eda-40cf-a63e-b371b70fbd56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:20.819192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-44b921f3-9eda-40cf-a63e-b371b70fbd56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: 77b1c253-7437-4a43-bc08-a0626125cd82] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:20.828146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b921f3-9eda-40cf-a63e-b371b70fbd56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:20.828647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b921f3-9eda-40cf-a63e-b371b70fbd56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:20.829468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b921f3-9eda-40cf-a63e-b371b70fbd56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:20.829949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b921f3-9eda-40cf-a63e-b371b70fbd56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:20.883518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-44b921f3-9eda-40cf-a63e-b371b70fbd56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] HTTP exception thrown: Instance 77b1c253-7437-4a43-bc08-a0626125cd82 could not be found. Apr 21 14:50:20.884204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44b921f3-9eda-40cf-a63e-b371b70fbd56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Returning 404 to user: Instance 77b1c253-7437-4a43-bc08-a0626125cd82 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:50:20.885108 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-44b921f3-9eda-40cf-a63e-b371b70fbd56 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82" status: 404 len: 111 microversion: 2.1 time: 0.071540 Apr 21 14:50:20.885721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 588/1108] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:50:20 2021] GET /compute/v2.1/servers/77b1c253-7437-4a43-bc08-a0626125cd82 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:50:21.393862 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0e5d859c-2f9c-4d6e-a3b0-825948ffedef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:21.394959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0e5d859c-2f9c-4d6e-a3b0-825948ffedef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:21.403409 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e5d859c-2f9c-4d6e-a3b0-825948ffedef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:21.403921 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e5d859c-2f9c-4d6e-a3b0-825948ffedef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:21.404752 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e5d859c-2f9c-4d6e-a3b0-825948ffedef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:21.405208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0e5d859c-2f9c-4d6e-a3b0-825948ffedef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:21.510236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0e5d859c-2f9c-4d6e-a3b0-825948ffedef tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 12677 microversion: 2.1 time: 0.120244 Apr 21 14:50:21.511015 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 521/1109] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:21 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 12677 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:22.142436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2e16c305-06df-4bc2-b8dd-f602214c928e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:22.142968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2e16c305-06df-4bc2-b8dd-f602214c928e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:22.152340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e16c305-06df-4bc2-b8dd-f602214c928e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:22.152855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e16c305-06df-4bc2-b8dd-f602214c928e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:22.153690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e16c305-06df-4bc2-b8dd-f602214c928e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:22.154216 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e16c305-06df-4bc2-b8dd-f602214c928e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:22.207289 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-2e16c305-06df-4bc2-b8dd-f602214c928e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] HTTP exception thrown: Instance abf3aa87-b02a-4b58-901a-76f4e825e75a could not be found. Apr 21 14:50:22.207964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2e16c305-06df-4bc2-b8dd-f602214c928e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Returning 404 to user: Instance abf3aa87-b02a-4b58-901a-76f4e825e75a could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:50:22.208875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2e16c305-06df-4bc2-b8dd-f602214c928e tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "DELETE /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 404 len: 111 microversion: 2.1 time: 0.070894 Apr 21 14:50:22.209480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 589/1110] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:50:22 2021] DELETE /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:50:22.219378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-049371a9-744d-4987-b77c-711e1ead12a4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:50:22.220225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-049371a9-744d-4987-b77c-711e1ead12a4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] [instance: abf3aa87-b02a-4b58-901a-76f4e825e75a] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:22.229316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-049371a9-744d-4987-b77c-711e1ead12a4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:22.229825 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-049371a9-744d-4987-b77c-711e1ead12a4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:22.230692 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-049371a9-744d-4987-b77c-711e1ead12a4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:22.231187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-049371a9-744d-4987-b77c-711e1ead12a4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:22.284651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-049371a9-744d-4987-b77c-711e1ead12a4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] HTTP exception thrown: Instance abf3aa87-b02a-4b58-901a-76f4e825e75a could not be found. Apr 21 14:50:22.285383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-049371a9-744d-4987-b77c-711e1ead12a4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] Returning 404 to user: Instance abf3aa87-b02a-4b58-901a-76f4e825e75a could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:50:22.286311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-049371a9-744d-4987-b77c-711e1ead12a4 tempest-AttachVolumeShelveTestJSON-646419207 tempest-AttachVolumeShelveTestJSON-646419207-project] 10.222.0.24 "GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a" status: 404 len: 111 microversion: 2.1 time: 0.071638 Apr 21 14:50:22.286946 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 522/1111] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:50:22 2021] GET /compute/v2.1/servers/abf3aa87-b02a-4b58-901a-76f4e825e75a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:50:22.533066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a937e90-b60a-41f6-9849-1c806952ab43 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:22.540000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a937e90-b60a-41f6-9849-1c806952ab43 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:22.548425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a937e90-b60a-41f6-9849-1c806952ab43 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:22.548915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a937e90-b60a-41f6-9849-1c806952ab43 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:22.550200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a937e90-b60a-41f6-9849-1c806952ab43 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:22.550705 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a937e90-b60a-41f6-9849-1c806952ab43 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:22.655151 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a937e90-b60a-41f6-9849-1c806952ab43 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 18498 microversion: 2.1 time: 0.136160 Apr 21 14:50:22.656107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 590/1112] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:22 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 18498 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:23.669083 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d0bba1a3-7d8b-49e7-bee9-0cf0a8fac419 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:23.670196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d0bba1a3-7d8b-49e7-bee9-0cf0a8fac419 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:23.679744 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d0bba1a3-7d8b-49e7-bee9-0cf0a8fac419 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:23.680320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d0bba1a3-7d8b-49e7-bee9-0cf0a8fac419 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:23.681073 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d0bba1a3-7d8b-49e7-bee9-0cf0a8fac419 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:23.681566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d0bba1a3-7d8b-49e7-bee9-0cf0a8fac419 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:23.784494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d0bba1a3-7d8b-49e7-bee9-0cf0a8fac419 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 19342 microversion: 2.1 time: 0.119204 Apr 21 14:50:23.785701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 523/1113] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:23 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 19342 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:24.800672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3342e187-ceb1-4614-a96b-d6e105eab4b1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:24.801783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3342e187-ceb1-4614-a96b-d6e105eab4b1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:24.811015 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3342e187-ceb1-4614-a96b-d6e105eab4b1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:24.811459 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3342e187-ceb1-4614-a96b-d6e105eab4b1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:24.812308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3342e187-ceb1-4614-a96b-d6e105eab4b1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:24.812809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3342e187-ceb1-4614-a96b-d6e105eab4b1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:24.923175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3342e187-ceb1-4614-a96b-d6e105eab4b1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 21935 microversion: 2.1 time: 0.127955 Apr 21 14:50:24.923892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 591/1114] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:24 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 21935 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:25.950452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8974c3ce-733e-424d-8f17-2d04f3116b94 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:25.952737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8974c3ce-733e-424d-8f17-2d04f3116b94 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:25.963723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8974c3ce-733e-424d-8f17-2d04f3116b94 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:25.965312 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8974c3ce-733e-424d-8f17-2d04f3116b94 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:25.966506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8974c3ce-733e-424d-8f17-2d04f3116b94 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:25.967256 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8974c3ce-733e-424d-8f17-2d04f3116b94 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:26.074657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8974c3ce-733e-424d-8f17-2d04f3116b94 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 23235 microversion: 2.1 time: 0.139211 Apr 21 14:50:26.076856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 524/1115] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:25 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 23235 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:27.094472 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-654ab661-2d72-4f4f-8a0a-5dcf0116c1f7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:27.096767 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-654ab661-2d72-4f4f-8a0a-5dcf0116c1f7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:27.114525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-654ab661-2d72-4f4f-8a0a-5dcf0116c1f7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:27.115539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-654ab661-2d72-4f4f-8a0a-5dcf0116c1f7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:27.117146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-654ab661-2d72-4f4f-8a0a-5dcf0116c1f7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:27.118072 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-654ab661-2d72-4f4f-8a0a-5dcf0116c1f7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:27.264700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-654ab661-2d72-4f4f-8a0a-5dcf0116c1f7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 24725 microversion: 2.1 time: 0.178938 Apr 21 14:50:27.269424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 592/1116] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:27 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 24725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:28.279017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c06c4650-c8ab-4913-bc71-f7a67e6d4f62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:28.280522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c06c4650-c8ab-4913-bc71-f7a67e6d4f62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:28.289718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c06c4650-c8ab-4913-bc71-f7a67e6d4f62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:28.290373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c06c4650-c8ab-4913-bc71-f7a67e6d4f62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:28.291285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c06c4650-c8ab-4913-bc71-f7a67e6d4f62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:28.291955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c06c4650-c8ab-4913-bc71-f7a67e6d4f62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:28.409240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c06c4650-c8ab-4913-bc71-f7a67e6d4f62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 26364 microversion: 2.1 time: 0.134833 Apr 21 14:50:28.410191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 525/1117] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:28 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 26364 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:50:29.423722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-704522d8-7d5a-430a-a182-8a8f3c3226dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:29.426331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-704522d8-7d5a-430a-a182-8a8f3c3226dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:29.436494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-704522d8-7d5a-430a-a182-8a8f3c3226dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:29.437016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-704522d8-7d5a-430a-a182-8a8f3c3226dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:29.438107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-704522d8-7d5a-430a-a182-8a8f3c3226dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:29.438620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-704522d8-7d5a-430a-a182-8a8f3c3226dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:29.550224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-704522d8-7d5a-430a-a182-8a8f3c3226dc tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 27552 microversion: 2.1 time: 0.130368 Apr 21 14:50:29.550923 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 593/1118] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:29 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 27552 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:50:30.563949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-26927e4e-1298-4568-8965-c7e292842244 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:30.565204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-26927e4e-1298-4568-8965-c7e292842244 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:30.574165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26927e4e-1298-4568-8965-c7e292842244 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:30.574670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26927e4e-1298-4568-8965-c7e292842244 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:30.575511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26927e4e-1298-4568-8965-c7e292842244 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:30.575992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26927e4e-1298-4568-8965-c7e292842244 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:30.682109 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-26927e4e-1298-4568-8965-c7e292842244 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 27906 microversion: 2.1 time: 0.122018 Apr 21 14:50:30.683555 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 526/1119] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:30 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 27906 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:31.698107 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ca7b76f2-1cbe-4cf7-b858-258490f2ce40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:31.700170 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ca7b76f2-1cbe-4cf7-b858-258490f2ce40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:31.711031 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca7b76f2-1cbe-4cf7-b858-258490f2ce40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:31.711534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca7b76f2-1cbe-4cf7-b858-258490f2ce40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:31.712444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca7b76f2-1cbe-4cf7-b858-258490f2ce40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:31.713042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca7b76f2-1cbe-4cf7-b858-258490f2ce40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:31.831229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ca7b76f2-1cbe-4cf7-b858-258490f2ce40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.138886 Apr 21 14:50:31.832217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 594/1120] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:31 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:32.845096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4d41b2f2-6c13-4a88-98b9-96dd9e4318a3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:32.846468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4d41b2f2-6c13-4a88-98b9-96dd9e4318a3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:32.855746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d41b2f2-6c13-4a88-98b9-96dd9e4318a3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:32.856257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d41b2f2-6c13-4a88-98b9-96dd9e4318a3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:32.857137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d41b2f2-6c13-4a88-98b9-96dd9e4318a3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:32.857604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d41b2f2-6c13-4a88-98b9-96dd9e4318a3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:32.954588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4d41b2f2-6c13-4a88-98b9-96dd9e4318a3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.114007 Apr 21 14:50:32.955533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 527/1121] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:32 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:33.969119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34d67d89-81ef-4d30-8b6e-b0059f9c0f91 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:33.970323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34d67d89-81ef-4d30-8b6e-b0059f9c0f91 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:33.980829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34d67d89-81ef-4d30-8b6e-b0059f9c0f91 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:33.981331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34d67d89-81ef-4d30-8b6e-b0059f9c0f91 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:33.982209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34d67d89-81ef-4d30-8b6e-b0059f9c0f91 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:33.982690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34d67d89-81ef-4d30-8b6e-b0059f9c0f91 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:34.087996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34d67d89-81ef-4d30-8b6e-b0059f9c0f91 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.123341 Apr 21 14:50:34.088824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 595/1122] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:33 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:35.102315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-be49e24d-b324-404e-a0f3-153d21c9f534 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:35.103680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-be49e24d-b324-404e-a0f3-153d21c9f534 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:35.113498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be49e24d-b324-404e-a0f3-153d21c9f534 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:35.114055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be49e24d-b324-404e-a0f3-153d21c9f534 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:35.114891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be49e24d-b324-404e-a0f3-153d21c9f534 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:35.115363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be49e24d-b324-404e-a0f3-153d21c9f534 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:38.910991 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-be49e24d-b324-404e-a0f3-153d21c9f534 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 3.813105 Apr 21 14:50:38.911948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 528/1123] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:35 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 3816 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:39.931809 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e4c4e64e-99bb-4a55-9adc-24619f3bdfc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:39.933912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e4c4e64e-99bb-4a55-9adc-24619f3bdfc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:39.950615 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4c4e64e-99bb-4a55-9adc-24619f3bdfc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:39.951506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4c4e64e-99bb-4a55-9adc-24619f3bdfc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:39.953055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4c4e64e-99bb-4a55-9adc-24619f3bdfc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:39.954170 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4c4e64e-99bb-4a55-9adc-24619f3bdfc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:40.119164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e4c4e64e-99bb-4a55-9adc-24619f3bdfc0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.195966 Apr 21 14:50:40.119816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 596/1124] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:39 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:41.135613 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-56190847-0953-4dbc-b812-02e7dae3599a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:41.137187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-56190847-0953-4dbc-b812-02e7dae3599a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:41.148611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56190847-0953-4dbc-b812-02e7dae3599a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:41.149124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56190847-0953-4dbc-b812-02e7dae3599a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:41.149974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56190847-0953-4dbc-b812-02e7dae3599a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:41.150523 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56190847-0953-4dbc-b812-02e7dae3599a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:41.257401 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-56190847-0953-4dbc-b812-02e7dae3599a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.128313 Apr 21 14:50:41.258149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 529/1125] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:41 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:42.270368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-91cf212e-38e6-436e-a58b-60b05334eb20 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:42.271551 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-91cf212e-38e6-436e-a58b-60b05334eb20 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:42.280537 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91cf212e-38e6-436e-a58b-60b05334eb20 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:42.281044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91cf212e-38e6-436e-a58b-60b05334eb20 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:42.281902 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91cf212e-38e6-436e-a58b-60b05334eb20 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:42.282415 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91cf212e-38e6-436e-a58b-60b05334eb20 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:42.395863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-91cf212e-38e6-436e-a58b-60b05334eb20 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.130063 Apr 21 14:50:42.396637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 597/1126] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:42 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:43.410185 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b5d63bc6-3b96-47d5-97a5-acf01431a97a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:43.411508 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b5d63bc6-3b96-47d5-97a5-acf01431a97a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:43.421270 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5d63bc6-3b96-47d5-97a5-acf01431a97a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:43.421779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5d63bc6-3b96-47d5-97a5-acf01431a97a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:43.422656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5d63bc6-3b96-47d5-97a5-acf01431a97a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:43.423144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5d63bc6-3b96-47d5-97a5-acf01431a97a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:43.530032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b5d63bc6-3b96-47d5-97a5-acf01431a97a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.124569 Apr 21 14:50:43.530802 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 530/1127] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:43 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:44.543567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c08d18a6-8c2d-4f08-837b-9baa62bc9b82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:44.544698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c08d18a6-8c2d-4f08-837b-9baa62bc9b82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:44.554481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c08d18a6-8c2d-4f08-837b-9baa62bc9b82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:44.554982 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c08d18a6-8c2d-4f08-837b-9baa62bc9b82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:44.555832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c08d18a6-8c2d-4f08-837b-9baa62bc9b82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:44.556315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c08d18a6-8c2d-4f08-837b-9baa62bc9b82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:44.658661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c08d18a6-8c2d-4f08-837b-9baa62bc9b82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.119377 Apr 21 14:50:44.659407 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 598/1128] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:44 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:45.671964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-428927c0-497c-4968-be8b-f9b2752c20f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:45.673168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-428927c0-497c-4968-be8b-f9b2752c20f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:45.682595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-428927c0-497c-4968-be8b-f9b2752c20f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:45.683104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-428927c0-497c-4968-be8b-f9b2752c20f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:45.683934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-428927c0-497c-4968-be8b-f9b2752c20f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:45.684413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-428927c0-497c-4968-be8b-f9b2752c20f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:45.788260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-428927c0-497c-4968-be8b-f9b2752c20f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.120672 Apr 21 14:50:45.788906 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 531/1129] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:45 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:46.802290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-57c163a2-3b11-4ffd-b67e-b7e33b6f88dd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:46.803452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-57c163a2-3b11-4ffd-b67e-b7e33b6f88dd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:46.812484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57c163a2-3b11-4ffd-b67e-b7e33b6f88dd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:46.812990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57c163a2-3b11-4ffd-b67e-b7e33b6f88dd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:46.813824 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57c163a2-3b11-4ffd-b67e-b7e33b6f88dd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:46.814385 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57c163a2-3b11-4ffd-b67e-b7e33b6f88dd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:46.917863 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-57c163a2-3b11-4ffd-b67e-b7e33b6f88dd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.119937 Apr 21 14:50:46.918844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 599/1130] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:46 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:47.933155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-60dceca3-cf18-4f35-bd16-3c9b22aabaa1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:47.934368 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-60dceca3-cf18-4f35-bd16-3c9b22aabaa1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:47.943614 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60dceca3-cf18-4f35-bd16-3c9b22aabaa1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:47.944123 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60dceca3-cf18-4f35-bd16-3c9b22aabaa1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:47.944966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60dceca3-cf18-4f35-bd16-3c9b22aabaa1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:47.945456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60dceca3-cf18-4f35-bd16-3c9b22aabaa1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:48.050110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-60dceca3-cf18-4f35-bd16-3c9b22aabaa1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.121007 Apr 21 14:50:48.051130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 532/1131] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:47 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:49.064489 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4362013b-567b-48ef-9dd2-fccf9027c087 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:49.065674 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4362013b-567b-48ef-9dd2-fccf9027c087 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:49.074796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4362013b-567b-48ef-9dd2-fccf9027c087 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:49.075299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4362013b-567b-48ef-9dd2-fccf9027c087 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:49.076117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4362013b-567b-48ef-9dd2-fccf9027c087 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:49.076599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4362013b-567b-48ef-9dd2-fccf9027c087 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:49.183218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4362013b-567b-48ef-9dd2-fccf9027c087 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.122757 Apr 21 14:50:49.183997 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 600/1132] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:49 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:50.198992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c973f577-262b-4860-9e13-4be4b6f88b41 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:50.200143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c973f577-262b-4860-9e13-4be4b6f88b41 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:50.209282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c973f577-262b-4860-9e13-4be4b6f88b41 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:50.209788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c973f577-262b-4860-9e13-4be4b6f88b41 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:50.210660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c973f577-262b-4860-9e13-4be4b6f88b41 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:50.211159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c973f577-262b-4860-9e13-4be4b6f88b41 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:50.324245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c973f577-262b-4860-9e13-4be4b6f88b41 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28204 microversion: 2.1 time: 0.130414 Apr 21 14:50:50.324966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 533/1133] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:50 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28204 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:51.338127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1d73b2cd-de06-4688-b594-83f2e64f70bf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:51.339194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1d73b2cd-de06-4688-b594-83f2e64f70bf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:51.348164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d73b2cd-de06-4688-b594-83f2e64f70bf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:51.348664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d73b2cd-de06-4688-b594-83f2e64f70bf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:51.349492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d73b2cd-de06-4688-b594-83f2e64f70bf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:51.349975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d73b2cd-de06-4688-b594-83f2e64f70bf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:51.457651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1d73b2cd-de06-4688-b594-83f2e64f70bf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28494 microversion: 2.1 time: 0.123581 Apr 21 14:50:51.458527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 601/1134] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:51 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28494 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:52.473016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07a2922e-4ba5-4fc7-b3b6-2efcac359f7d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:52.474272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-07a2922e-4ba5-4fc7-b3b6-2efcac359f7d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:52.484651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a2922e-4ba5-4fc7-b3b6-2efcac359f7d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:52.485243 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a2922e-4ba5-4fc7-b3b6-2efcac359f7d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:52.486347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a2922e-4ba5-4fc7-b3b6-2efcac359f7d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:52.486841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a2922e-4ba5-4fc7-b3b6-2efcac359f7d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:52.591947 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-07a2922e-4ba5-4fc7-b3b6-2efcac359f7d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28494 microversion: 2.1 time: 0.123421 Apr 21 14:50:52.592887 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 534/1135] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:52 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28494 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:53.606211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aa5b86d6-0183-4b19-982d-57a83a1a899a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:53.607552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aa5b86d6-0183-4b19-982d-57a83a1a899a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:53.616938 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa5b86d6-0183-4b19-982d-57a83a1a899a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:53.617449 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa5b86d6-0183-4b19-982d-57a83a1a899a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:53.618373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa5b86d6-0183-4b19-982d-57a83a1a899a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:53.618848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa5b86d6-0183-4b19-982d-57a83a1a899a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:53.719788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aa5b86d6-0183-4b19-982d-57a83a1a899a tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.117643 Apr 21 14:50:53.720424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 602/1136] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:53 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:54.734937 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fe193548-60bc-47e2-a0f5-f1de72c08f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:54.736166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fe193548-60bc-47e2-a0f5-f1de72c08f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:54.745217 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe193548-60bc-47e2-a0f5-f1de72c08f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:54.745712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe193548-60bc-47e2-a0f5-f1de72c08f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:54.746659 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe193548-60bc-47e2-a0f5-f1de72c08f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:54.747169 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fe193548-60bc-47e2-a0f5-f1de72c08f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:54.849762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fe193548-60bc-47e2-a0f5-f1de72c08f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.119200 Apr 21 14:50:54.850540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 535/1137] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:54 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:55.867331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3e94eef3-6fe6-4d69-9d27-f65312332913 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:55.869198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3e94eef3-6fe6-4d69-9d27-f65312332913 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:55.878667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e94eef3-6fe6-4d69-9d27-f65312332913 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:55.879171 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e94eef3-6fe6-4d69-9d27-f65312332913 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:55.880001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e94eef3-6fe6-4d69-9d27-f65312332913 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:55.880493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e94eef3-6fe6-4d69-9d27-f65312332913 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:55.984133 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3e94eef3-6fe6-4d69-9d27-f65312332913 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.124079 Apr 21 14:50:55.985262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 603/1138] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:55 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:50:57.001804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-598d86c2-76b5-45a3-a81c-fe6fc0e575f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:50:57.003244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-598d86c2-76b5-45a3-a81c-fe6fc0e575f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:50:57.014841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-598d86c2-76b5-45a3-a81c-fe6fc0e575f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:57.015357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-598d86c2-76b5-45a3-a81c-fe6fc0e575f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:50:57.016206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-598d86c2-76b5-45a3-a81c-fe6fc0e575f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:50:57.016704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-598d86c2-76b5-45a3-a81c-fe6fc0e575f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:00.585598 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-598d86c2-76b5-45a3-a81c-fe6fc0e575f0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 3.590409 Apr 21 14:51:00.586690 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 536/1139] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:50:56 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 3594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:01.606478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b6b6520-f1c9-4d0f-95f0-655647440dd1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:01.607644 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b6b6520-f1c9-4d0f-95f0-655647440dd1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:01.617130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6b6520-f1c9-4d0f-95f0-655647440dd1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:01.617640 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6b6520-f1c9-4d0f-95f0-655647440dd1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:01.618530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6b6520-f1c9-4d0f-95f0-655647440dd1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:01.619022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6b6520-f1c9-4d0f-95f0-655647440dd1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:04.486344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b6b6520-f1c9-4d0f-95f0-655647440dd1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 2.886715 Apr 21 14:51:04.487165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 604/1140] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:01 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 2890 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:05.502986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3fc6dc64-9c79-427f-b666-45654637e8a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:05.504333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3fc6dc64-9c79-427f-b666-45654637e8a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:05.516335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fc6dc64-9c79-427f-b666-45654637e8a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:05.517164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fc6dc64-9c79-427f-b666-45654637e8a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:05.518439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fc6dc64-9c79-427f-b666-45654637e8a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:05.518818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fc6dc64-9c79-427f-b666-45654637e8a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:05.627287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3fc6dc64-9c79-427f-b666-45654637e8a7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.130953 Apr 21 14:51:05.627998 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 537/1141] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:05 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:06.641447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8c39e23e-4756-4e77-aa29-7bf3f87dd23b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:06.642608 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8c39e23e-4756-4e77-aa29-7bf3f87dd23b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:06.652344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c39e23e-4756-4e77-aa29-7bf3f87dd23b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:06.652864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c39e23e-4756-4e77-aa29-7bf3f87dd23b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:06.653709 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c39e23e-4756-4e77-aa29-7bf3f87dd23b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:06.654268 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c39e23e-4756-4e77-aa29-7bf3f87dd23b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:06.756335 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8c39e23e-4756-4e77-aa29-7bf3f87dd23b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.119314 Apr 21 14:51:06.757038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 605/1142] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:06 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:07.769456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e7e8cd48-3eee-468a-acd7-79db266d8ee3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:07.770700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e7e8cd48-3eee-468a-acd7-79db266d8ee3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:07.779710 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7e8cd48-3eee-468a-acd7-79db266d8ee3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:07.780218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7e8cd48-3eee-468a-acd7-79db266d8ee3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:07.781056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7e8cd48-3eee-468a-acd7-79db266d8ee3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:07.781547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7e8cd48-3eee-468a-acd7-79db266d8ee3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:07.887193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e7e8cd48-3eee-468a-acd7-79db266d8ee3 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.122110 Apr 21 14:51:07.887874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 538/1143] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:07 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:08.902125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4b2fbcb8-ab9c-4c10-9309-db976f644642 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:08.903290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4b2fbcb8-ab9c-4c10-9309-db976f644642 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:08.913436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b2fbcb8-ab9c-4c10-9309-db976f644642 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:08.914253 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b2fbcb8-ab9c-4c10-9309-db976f644642 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:08.914877 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b2fbcb8-ab9c-4c10-9309-db976f644642 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:08.916493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b2fbcb8-ab9c-4c10-9309-db976f644642 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:09.028611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4b2fbcb8-ab9c-4c10-9309-db976f644642 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.130126 Apr 21 14:51:09.028611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 606/1144] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:08 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:10.041550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-53a56d3b-1b92-4e66-ba82-c3224727378f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:10.042801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-53a56d3b-1b92-4e66-ba82-c3224727378f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:10.053136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53a56d3b-1b92-4e66-ba82-c3224727378f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:10.053640 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53a56d3b-1b92-4e66-ba82-c3224727378f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:10.054605 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53a56d3b-1b92-4e66-ba82-c3224727378f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:10.055105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-53a56d3b-1b92-4e66-ba82-c3224727378f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:10.155779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-53a56d3b-1b92-4e66-ba82-c3224727378f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.118667 Apr 21 14:51:10.156527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 539/1145] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:10 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:11.169715 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fa1a77e3-6513-40d9-8998-8a3277630af0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:11.170965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fa1a77e3-6513-40d9-8998-8a3277630af0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:11.180405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa1a77e3-6513-40d9-8998-8a3277630af0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:11.180918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa1a77e3-6513-40d9-8998-8a3277630af0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:11.181764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa1a77e3-6513-40d9-8998-8a3277630af0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:11.182286 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa1a77e3-6513-40d9-8998-8a3277630af0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:11.290897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fa1a77e3-6513-40d9-8998-8a3277630af0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.124481 Apr 21 14:51:11.291883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 607/1146] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:11 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:12.305565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-35633cdd-86d8-4b03-97bd-3a9cd5f23190 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:12.306743 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-35633cdd-86d8-4b03-97bd-3a9cd5f23190 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:12.315720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35633cdd-86d8-4b03-97bd-3a9cd5f23190 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:12.316227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35633cdd-86d8-4b03-97bd-3a9cd5f23190 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:12.317060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35633cdd-86d8-4b03-97bd-3a9cd5f23190 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:12.317549 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35633cdd-86d8-4b03-97bd-3a9cd5f23190 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:12.423596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-35633cdd-86d8-4b03-97bd-3a9cd5f23190 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.122097 Apr 21 14:51:12.424991 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 540/1147] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:12 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:13.440700 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0f4385da-f37b-493e-b2bf-d282a67a64db tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:13.442043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0f4385da-f37b-493e-b2bf-d282a67a64db tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:13.451862 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f4385da-f37b-493e-b2bf-d282a67a64db tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:13.452376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f4385da-f37b-493e-b2bf-d282a67a64db tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:13.453230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f4385da-f37b-493e-b2bf-d282a67a64db tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:13.453719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f4385da-f37b-493e-b2bf-d282a67a64db tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:16.435787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0f4385da-f37b-493e-b2bf-d282a67a64db tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 2.999961 Apr 21 14:51:16.436492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 608/1148] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:13 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 3002 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:17.449626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c31fed88-d601-4619-8cdb-2dfbd24053cf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:17.451174 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c31fed88-d601-4619-8cdb-2dfbd24053cf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:17.460771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c31fed88-d601-4619-8cdb-2dfbd24053cf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:17.461288 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c31fed88-d601-4619-8cdb-2dfbd24053cf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:17.462155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c31fed88-d601-4619-8cdb-2dfbd24053cf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:17.462647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c31fed88-d601-4619-8cdb-2dfbd24053cf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:17.564412 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c31fed88-d601-4619-8cdb-2dfbd24053cf tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.119145 Apr 21 14:51:17.565836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 541/1149] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:17 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:18.578182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-86fe5ccd-e6cb-40e9-8c7a-5509b0a414a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:18.579373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-86fe5ccd-e6cb-40e9-8c7a-5509b0a414a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:18.588525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86fe5ccd-e6cb-40e9-8c7a-5509b0a414a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:18.589034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86fe5ccd-e6cb-40e9-8c7a-5509b0a414a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:18.589879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86fe5ccd-e6cb-40e9-8c7a-5509b0a414a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:18.590399 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86fe5ccd-e6cb-40e9-8c7a-5509b0a414a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:18.701703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-86fe5ccd-e6cb-40e9-8c7a-5509b0a414a8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.127867 Apr 21 14:51:18.702457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 609/1150] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:18 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:19.716965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-84fe63e2-0c46-450e-bd0b-166d941a4ddb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:19.718117 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-84fe63e2-0c46-450e-bd0b-166d941a4ddb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:19.726978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84fe63e2-0c46-450e-bd0b-166d941a4ddb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:19.727466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84fe63e2-0c46-450e-bd0b-166d941a4ddb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:19.728294 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84fe63e2-0c46-450e-bd0b-166d941a4ddb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:19.728781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84fe63e2-0c46-450e-bd0b-166d941a4ddb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:19.842064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-84fe63e2-0c46-450e-bd0b-166d941a4ddb tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.129033 Apr 21 14:51:19.842708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 542/1151] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:19 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:20.856066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-74e891eb-0ea7-4640-845f-c2bee76f25b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:20.857205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-74e891eb-0ea7-4640-845f-c2bee76f25b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:20.866487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74e891eb-0ea7-4640-845f-c2bee76f25b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:20.867009 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74e891eb-0ea7-4640-845f-c2bee76f25b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:20.867865 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74e891eb-0ea7-4640-845f-c2bee76f25b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:20.868362 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74e891eb-0ea7-4640-845f-c2bee76f25b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:20.975358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-74e891eb-0ea7-4640-845f-c2bee76f25b7 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.123628 Apr 21 14:51:20.976071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 610/1152] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:20 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:21.988695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1537aa59-e7ff-41ed-a28a-8f00db4ee300 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:21.989973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1537aa59-e7ff-41ed-a28a-8f00db4ee300 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:21.999288 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1537aa59-e7ff-41ed-a28a-8f00db4ee300 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:21.999754 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1537aa59-e7ff-41ed-a28a-8f00db4ee300 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:22.000651 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1537aa59-e7ff-41ed-a28a-8f00db4ee300 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:22.001135 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1537aa59-e7ff-41ed-a28a-8f00db4ee300 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:22.115450 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1537aa59-e7ff-41ed-a28a-8f00db4ee300 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.131591 Apr 21 14:51:22.116236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 543/1153] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:21 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:23.129846 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dc022b50-1c56-41c4-b66b-82e7def0bfe8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:23.131167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dc022b50-1c56-41c4-b66b-82e7def0bfe8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:23.140308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc022b50-1c56-41c4-b66b-82e7def0bfe8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:23.140816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc022b50-1c56-41c4-b66b-82e7def0bfe8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:23.141657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc022b50-1c56-41c4-b66b-82e7def0bfe8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:23.142197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc022b50-1c56-41c4-b66b-82e7def0bfe8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:23.242310 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dc022b50-1c56-41c4-b66b-82e7def0bfe8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.117032 Apr 21 14:51:23.242981 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 611/1154] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:23 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:24.255884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ad631890-b790-4e7c-b1ab-a0d3b65d8676 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:24.257145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ad631890-b790-4e7c-b1ab-a0d3b65d8676 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:24.266206 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad631890-b790-4e7c-b1ab-a0d3b65d8676 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:24.266720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad631890-b790-4e7c-b1ab-a0d3b65d8676 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:24.267609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad631890-b790-4e7c-b1ab-a0d3b65d8676 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:24.268111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad631890-b790-4e7c-b1ab-a0d3b65d8676 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:24.368589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ad631890-b790-4e7c-b1ab-a0d3b65d8676 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.116826 Apr 21 14:51:24.369461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 544/1155] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:24 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:25.382475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1a45d6fa-654f-4267-adda-6eaf1bc98cdd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:25.383640 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1a45d6fa-654f-4267-adda-6eaf1bc98cdd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:25.392517 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a45d6fa-654f-4267-adda-6eaf1bc98cdd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:25.393022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a45d6fa-654f-4267-adda-6eaf1bc98cdd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:25.393858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a45d6fa-654f-4267-adda-6eaf1bc98cdd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:25.394376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a45d6fa-654f-4267-adda-6eaf1bc98cdd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:25.505220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1a45d6fa-654f-4267-adda-6eaf1bc98cdd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.127079 Apr 21 14:51:25.505949 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 612/1156] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:25 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:26.519521 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f37dcff-fb53-4afe-a7e0-0a92fcf172cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:26.520666 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f37dcff-fb53-4afe-a7e0-0a92fcf172cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:26.529511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f37dcff-fb53-4afe-a7e0-0a92fcf172cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:26.530050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f37dcff-fb53-4afe-a7e0-0a92fcf172cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:26.530883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f37dcff-fb53-4afe-a7e0-0a92fcf172cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:26.531361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f37dcff-fb53-4afe-a7e0-0a92fcf172cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:26.634755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f37dcff-fb53-4afe-a7e0-0a92fcf172cd tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.119769 Apr 21 14:51:26.635575 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 545/1157] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:26 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:27.648580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eacc33d8-a7a5-4354-81e7-48f031039042 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:27.649758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eacc33d8-a7a5-4354-81e7-48f031039042 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:27.659388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eacc33d8-a7a5-4354-81e7-48f031039042 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:27.659985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eacc33d8-a7a5-4354-81e7-48f031039042 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:27.660835 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eacc33d8-a7a5-4354-81e7-48f031039042 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:27.661319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eacc33d8-a7a5-4354-81e7-48f031039042 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:27.762758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eacc33d8-a7a5-4354-81e7-48f031039042 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.118671 Apr 21 14:51:27.763908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 613/1158] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:27 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:28.776645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-62e37ef4-c553-400b-b104-380d6ab1a01b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:28.778014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-62e37ef4-c553-400b-b104-380d6ab1a01b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:28.788224 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62e37ef4-c553-400b-b104-380d6ab1a01b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:28.788698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62e37ef4-c553-400b-b104-380d6ab1a01b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:28.789856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62e37ef4-c553-400b-b104-380d6ab1a01b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:28.790386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62e37ef4-c553-400b-b104-380d6ab1a01b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:28.895594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-62e37ef4-c553-400b-b104-380d6ab1a01b tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.123431 Apr 21 14:51:28.896829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 546/1159] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:28 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:29.910022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5b60eb9f-44d4-4a81-a66a-726aa2f7cbfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:29.911280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5b60eb9f-44d4-4a81-a66a-726aa2f7cbfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:29.920464 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b60eb9f-44d4-4a81-a66a-726aa2f7cbfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:29.920992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b60eb9f-44d4-4a81-a66a-726aa2f7cbfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:29.921830 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b60eb9f-44d4-4a81-a66a-726aa2f7cbfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:29.922400 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b60eb9f-44d4-4a81-a66a-726aa2f7cbfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:30.023904 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5b60eb9f-44d4-4a81-a66a-726aa2f7cbfa tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.118227 Apr 21 14:51:30.025023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 614/1160] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:29 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:31.040749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-454896ba-36e5-4efb-bbab-2e5ec9306f17 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:31.042228 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-454896ba-36e5-4efb-bbab-2e5ec9306f17 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:31.051833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-454896ba-36e5-4efb-bbab-2e5ec9306f17 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:31.052317 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-454896ba-36e5-4efb-bbab-2e5ec9306f17 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:31.053153 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-454896ba-36e5-4efb-bbab-2e5ec9306f17 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:31.053640 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-454896ba-36e5-4efb-bbab-2e5ec9306f17 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:31.167797 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-454896ba-36e5-4efb-bbab-2e5ec9306f17 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.134590 Apr 21 14:51:31.168742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 547/1161] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:31 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:32.183174 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-42c1be36-793b-44ce-b808-e721f5ba61a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:32.184330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-42c1be36-793b-44ce-b808-e721f5ba61a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:32.194841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-42c1be36-793b-44ce-b808-e721f5ba61a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:32.195396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-42c1be36-793b-44ce-b808-e721f5ba61a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:32.196600 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-42c1be36-793b-44ce-b808-e721f5ba61a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:32.197237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-42c1be36-793b-44ce-b808-e721f5ba61a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:32.304094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-42c1be36-793b-44ce-b808-e721f5ba61a4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.125335 Apr 21 14:51:32.304826 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 615/1162] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:32 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:33.321428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-90623441-4cfd-4ed0-ac5e-4d65af85b677 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:33.322510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-90623441-4cfd-4ed0-ac5e-4d65af85b677 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:33.331670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90623441-4cfd-4ed0-ac5e-4d65af85b677 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:33.332181 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90623441-4cfd-4ed0-ac5e-4d65af85b677 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:33.333027 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90623441-4cfd-4ed0-ac5e-4d65af85b677 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:33.333533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90623441-4cfd-4ed0-ac5e-4d65af85b677 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:34.826643 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-90623441-4cfd-4ed0-ac5e-4d65af85b677 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 1.511828 Apr 21 14:51:34.827601 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 548/1163] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:33 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:35.843969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9b5d59e8-544b-45bb-8d7f-8ca2e1f21410 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:35.845165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9b5d59e8-544b-45bb-8d7f-8ca2e1f21410 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:35.855733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b5d59e8-544b-45bb-8d7f-8ca2e1f21410 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:35.856285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b5d59e8-544b-45bb-8d7f-8ca2e1f21410 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:35.857164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b5d59e8-544b-45bb-8d7f-8ca2e1f21410 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:35.857678 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b5d59e8-544b-45bb-8d7f-8ca2e1f21410 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:36.457155 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9b5d59e8-544b-45bb-8d7f-8ca2e1f21410 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.618547 Apr 21 14:51:36.457977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 616/1164] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:35 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:37.471257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-de371712-2edd-4651-895d-d3d368d528df tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:37.472388 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-de371712-2edd-4651-895d-d3d368d528df tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:37.481468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de371712-2edd-4651-895d-d3d368d528df tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:37.482006 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de371712-2edd-4651-895d-d3d368d528df tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:37.482803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de371712-2edd-4651-895d-d3d368d528df tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:37.483309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de371712-2edd-4651-895d-d3d368d528df tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:37.595884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-de371712-2edd-4651-895d-d3d368d528df tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 28662 microversion: 2.1 time: 0.128578 Apr 21 14:51:37.597050 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 549/1165] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:37 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 28662 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:38.614159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-692d933c-10f2-4797-9462-2893e3282692 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:38.615352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-692d933c-10f2-4797-9462-2893e3282692 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:38.624593 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-692d933c-10f2-4797-9462-2893e3282692 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:38.625103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-692d933c-10f2-4797-9462-2893e3282692 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:38.625954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-692d933c-10f2-4797-9462-2893e3282692 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:38.626482 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-692d933c-10f2-4797-9462-2893e3282692 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:38.728871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-692d933c-10f2-4797-9462-2893e3282692 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 30138 microversion: 2.1 time: 0.119276 Apr 21 14:51:38.729664 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 617/1166] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:38 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 30138 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:39.745745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a6117d9d-3700-443b-9d31-2a7917f1bf40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:39.746909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a6117d9d-3700-443b-9d31-2a7917f1bf40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:39.755927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6117d9d-3700-443b-9d31-2a7917f1bf40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:39.756440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6117d9d-3700-443b-9d31-2a7917f1bf40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:39.757280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6117d9d-3700-443b-9d31-2a7917f1bf40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:39.757773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6117d9d-3700-443b-9d31-2a7917f1bf40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:39.859742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a6117d9d-3700-443b-9d31-2a7917f1bf40 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 32236 microversion: 2.1 time: 0.120196 Apr 21 14:51:39.860461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 550/1167] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:39 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 32236 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:40.875075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-977698e4-1a96-42e4-98ea-8c35af0c52ba tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:40.876316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-977698e4-1a96-42e4-98ea-8c35af0c52ba tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:40.885596 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-977698e4-1a96-42e4-98ea-8c35af0c52ba tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:40.886137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-977698e4-1a96-42e4-98ea-8c35af0c52ba tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:40.886973 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-977698e4-1a96-42e4-98ea-8c35af0c52ba tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:40.887466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-977698e4-1a96-42e4-98ea-8c35af0c52ba tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:40.991454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-977698e4-1a96-42e4-98ea-8c35af0c52ba tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 33523 microversion: 2.1 time: 0.121431 Apr 21 14:51:40.992315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 618/1168] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:40 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 33523 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:42.005230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d60db0f3-fc06-48a6-b64f-ccbaa7ae4065 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:42.007002 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d60db0f3-fc06-48a6-b64f-ccbaa7ae4065 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:42.016526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d60db0f3-fc06-48a6-b64f-ccbaa7ae4065 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:42.017297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d60db0f3-fc06-48a6-b64f-ccbaa7ae4065 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:42.018344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d60db0f3-fc06-48a6-b64f-ccbaa7ae4065 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:42.019086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d60db0f3-fc06-48a6-b64f-ccbaa7ae4065 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:42.123811 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d60db0f3-fc06-48a6-b64f-ccbaa7ae4065 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 34770 microversion: 2.1 time: 0.122757 Apr 21 14:51:42.125378 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 551/1169] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:41 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 34770 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:43.142858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a217fbb7-f76c-4857-9405-ac38ebcca675 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:43.144080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a217fbb7-f76c-4857-9405-ac38ebcca675 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:43.153115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a217fbb7-f76c-4857-9405-ac38ebcca675 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:43.153609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a217fbb7-f76c-4857-9405-ac38ebcca675 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:43.154558 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a217fbb7-f76c-4857-9405-ac38ebcca675 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:43.155054 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a217fbb7-f76c-4857-9405-ac38ebcca675 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:43.258305 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a217fbb7-f76c-4857-9405-ac38ebcca675 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 35900 microversion: 2.1 time: 0.120385 Apr 21 14:51:43.259467 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 619/1170] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:43 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 35900 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:44.272308 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-afe6fb35-eb86-444d-ac8d-aed4498a5993 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:44.273689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-afe6fb35-eb86-444d-ac8d-aed4498a5993 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:44.283307 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afe6fb35-eb86-444d-ac8d-aed4498a5993 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:44.283820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afe6fb35-eb86-444d-ac8d-aed4498a5993 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:44.284672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afe6fb35-eb86-444d-ac8d-aed4498a5993 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:44.285167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afe6fb35-eb86-444d-ac8d-aed4498a5993 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:44.392100 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-afe6fb35-eb86-444d-ac8d-aed4498a5993 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 37643 microversion: 2.1 time: 0.124322 Apr 21 14:51:44.392821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 552/1171] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:44 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 37643 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:45.406204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8ade6b9d-194b-4759-9d6a-e49fdc22aa8e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:45.407336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8ade6b9d-194b-4759-9d6a-e49fdc22aa8e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:45.416188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ade6b9d-194b-4759-9d6a-e49fdc22aa8e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:45.416698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ade6b9d-194b-4759-9d6a-e49fdc22aa8e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:45.417536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ade6b9d-194b-4759-9d6a-e49fdc22aa8e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:45.418055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ade6b9d-194b-4759-9d6a-e49fdc22aa8e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:45.528911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8ade6b9d-194b-4759-9d6a-e49fdc22aa8e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 38194 microversion: 2.1 time: 0.127261 Apr 21 14:51:45.530530 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 620/1172] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:45 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 38194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:46.542850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4cc1b2ff-47b3-45ef-b75a-c10e6cd13c62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:46.544158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4cc1b2ff-47b3-45ef-b75a-c10e6cd13c62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:46.553867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cc1b2ff-47b3-45ef-b75a-c10e6cd13c62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:46.554417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cc1b2ff-47b3-45ef-b75a-c10e6cd13c62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:46.555313 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cc1b2ff-47b3-45ef-b75a-c10e6cd13c62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:46.555880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4cc1b2ff-47b3-45ef-b75a-c10e6cd13c62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:46.657936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4cc1b2ff-47b3-45ef-b75a-c10e6cd13c62 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 38194 microversion: 2.1 time: 0.118421 Apr 21 14:51:46.657936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 553/1173] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:46 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 38194 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:47.670125 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0182041e-842f-4040-8d9a-87d184de0c2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:47.671303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0182041e-842f-4040-8d9a-87d184de0c2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:47.680488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0182041e-842f-4040-8d9a-87d184de0c2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:47.680997 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0182041e-842f-4040-8d9a-87d184de0c2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:47.681837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0182041e-842f-4040-8d9a-87d184de0c2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:47.682366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0182041e-842f-4040-8d9a-87d184de0c2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:47.793104 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0182041e-842f-4040-8d9a-87d184de0c2f tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 38194 microversion: 2.1 time: 0.127400 Apr 21 14:51:47.794167 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 621/1174] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:47 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 38194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:48.807428 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6238be91-7b01-40f8-82ca-209aea474306 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:48.808713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6238be91-7b01-40f8-82ca-209aea474306 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:48.818197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6238be91-7b01-40f8-82ca-209aea474306 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:48.818712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6238be91-7b01-40f8-82ca-209aea474306 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:48.819556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6238be91-7b01-40f8-82ca-209aea474306 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:48.820069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6238be91-7b01-40f8-82ca-209aea474306 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:48.919282 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6238be91-7b01-40f8-82ca-209aea474306 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 38194 microversion: 2.1 time: 0.116588 Apr 21 14:51:48.920033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 554/1175] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:48 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 38194 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:49.933607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-690d84d5-a291-4f84-b1bb-866166ea3ba4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:49.934839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-690d84d5-a291-4f84-b1bb-866166ea3ba4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:49.944230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-690d84d5-a291-4f84-b1bb-866166ea3ba4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:49.944746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-690d84d5-a291-4f84-b1bb-866166ea3ba4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:49.945585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-690d84d5-a291-4f84-b1bb-866166ea3ba4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:49.946120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-690d84d5-a291-4f84-b1bb-866166ea3ba4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:50.046757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-690d84d5-a291-4f84-b1bb-866166ea3ba4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action" status: 200 len: 38325 microversion: 2.1 time: 0.117557 Apr 21 14:51:50.047494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 622/1176] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:51:49 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/action => generated 38325 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:51:50.061339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-908a3194-0e43-48bc-8b6b-30bb31934b5d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:51:50.062022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-908a3194-0e43-48bc-8b6b-30bb31934b5d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:50.070853 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-908a3194-0e43-48bc-8b6b-30bb31934b5d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:50.071353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-908a3194-0e43-48bc-8b6b-30bb31934b5d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:50.072178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-908a3194-0e43-48bc-8b6b-30bb31934b5d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:50.072663 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-908a3194-0e43-48bc-8b6b-30bb31934b5d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:50.136391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-908a3194-0e43-48bc-8b6b-30bb31934b5d tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/ips" status: 200 len: 146 microversion: 2.1 time: 0.080939 Apr 21 14:51:50.137470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 555/1177] 10.222.0.24 () {58 vars in 1238 bytes} [Wed Apr 21 14:51:50 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/ips => generated 146 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:51:51.809617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-18f72bb5-0b4b-4e50-9c58-c36e78fb6175 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26a811f1-5590-47a2-887f-d428e6e40798"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:51:51.810953 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-18f72bb5-0b4b-4e50-9c58-c36e78fb6175 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:51:51.820033 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18f72bb5-0b4b-4e50-9c58-c36e78fb6175 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:51.820544 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18f72bb5-0b4b-4e50-9c58-c36e78fb6175 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:51.821391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18f72bb5-0b4b-4e50-9c58-c36e78fb6175 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:51:51.821867 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18f72bb5-0b4b-4e50-9c58-c36e78fb6175 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:51:52.211522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-18f72bb5-0b4b-4e50-9c58-c36e78fb6175 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406414 Apr 21 14:51:52.212288 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 623/1178] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:51:51 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:51:55.039081 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:51:55.039497 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:51:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:52:02.322513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ade47bc4-6103-45ed-82fd-868028e3afc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:02.323581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ade47bc4-6103-45ed-82fd-868028e3afc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:02.332474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ade47bc4-6103-45ed-82fd-868028e3afc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:02.332882 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ade47bc4-6103-45ed-82fd-868028e3afc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:02.333778 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ade47bc4-6103-45ed-82fd-868028e3afc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:02.334301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ade47bc4-6103-45ed-82fd-868028e3afc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:02.406423 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ade47bc4-6103-45ed-82fd-868028e3afc1 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088284 Apr 21 14:52:02.407051 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 556/1179] 10.222.0.24 () {58 vars in 1292 bytes} [Wed Apr 21 14:52:02 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:02.423606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-93bd2426-8027-4a04-a859-94af100f0792 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:02.424971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-93bd2426-8027-4a04-a859-94af100f0792 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:02.438215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93bd2426-8027-4a04-a859-94af100f0792 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:02.438732 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93bd2426-8027-4a04-a859-94af100f0792 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:02.439579 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93bd2426-8027-4a04-a859-94af100f0792 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:02.440076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93bd2426-8027-4a04-a859-94af100f0792 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:02.510976 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-93bd2426-8027-4a04-a859-94af100f0792 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/26a811f1-5590-47a2-887f-d428e6e40798" status: 200 len: 194 microversion: 2.1 time: 0.095972 Apr 21 14:52:02.511694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 624/1180] 10.222.0.24 () {58 vars in 1403 bytes} [Wed Apr 21 14:52:02 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/26a811f1-5590-47a2-887f-d428e6e40798 => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:04.055437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d1be9704-9f99-4a78-9934-beecca1ef019 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c82cb07-0c8f-4e22-820a-b7f9b7c4845d"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:52:04.056626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d1be9704-9f99-4a78-9934-beecca1ef019 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:04.064721 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1be9704-9f99-4a78-9934-beecca1ef019 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:04.065237 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1be9704-9f99-4a78-9934-beecca1ef019 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:04.066126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1be9704-9f99-4a78-9934-beecca1ef019 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:04.066622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1be9704-9f99-4a78-9934-beecca1ef019 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:04.473161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d1be9704-9f99-4a78-9934-beecca1ef019 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421684 Apr 21 14:52:04.474144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 557/1181] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:52:04 2021] POST /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:12.365236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-16937b98-c48b-49e7-b2c6-e33c0f6dd785 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:12.367053 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-16937b98-c48b-49e7-b2c6-e33c0f6dd785 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:12.380897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16937b98-c48b-49e7-b2c6-e33c0f6dd785 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:12.381713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16937b98-c48b-49e7-b2c6-e33c0f6dd785 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:12.384209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16937b98-c48b-49e7-b2c6-e33c0f6dd785 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:12.384998 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16937b98-c48b-49e7-b2c6-e33c0f6dd785 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:12.456816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-16937b98-c48b-49e7-b2c6-e33c0f6dd785 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.098790 Apr 21 14:52:12.457445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 625/1182] 10.222.0.24 () {58 vars in 1292 bytes} [Wed Apr 21 14:52:12 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:12.663945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4fa267f2-56bf-4cc2-805a-51187476454e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:12.664630 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4fa267f2-56bf-4cc2-805a-51187476454e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:12.674862 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fa267f2-56bf-4cc2-805a-51187476454e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:12.675376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fa267f2-56bf-4cc2-805a-51187476454e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:12.676214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fa267f2-56bf-4cc2-805a-51187476454e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:12.676702 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fa267f2-56bf-4cc2-805a-51187476454e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:12.749595 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4fa267f2-56bf-4cc2-805a-51187476454e tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/26a811f1-5590-47a2-887f-d428e6e40798" status: 200 len: 194 microversion: 2.1 time: 0.090303 Apr 21 14:52:12.750296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 558/1183] 10.222.0.24 () {58 vars in 1403 bytes} [Wed Apr 21 14:52:12 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/26a811f1-5590-47a2-887f-d428e6e40798 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:12.764393 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-57b94e6d-d157-445c-905d-4abb64f34977 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:12.765406 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-57b94e6d-d157-445c-905d-4abb64f34977 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:12.777261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57b94e6d-d157-445c-905d-4abb64f34977 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:12.777772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57b94e6d-d157-445c-905d-4abb64f34977 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:12.778637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57b94e6d-d157-445c-905d-4abb64f34977 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:12.779130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57b94e6d-d157-445c-905d-4abb64f34977 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:12.966533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-57b94e6d-d157-445c-905d-4abb64f34977 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lazy-loading 'services' on Instance uuid 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:52:13.122641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-57b94e6d-d157-445c-905d-4abb64f34977 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "DELETE /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/26a811f1-5590-47a2-887f-d428e6e40798" status: 202 len: 0 microversion: 2.1 time: 0.365050 Apr 21 14:52:13.123504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 626/1184] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:52:12 2021] DELETE /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/26a811f1-5590-47a2-887f-d428e6e40798 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:52:15.455833 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0dd6ab67-6ec7-4b81-8a73-6cf3f5c2cac4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:15.456366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0dd6ab67-6ec7-4b81-8a73-6cf3f5c2cac4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:15.465236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0dd6ab67-6ec7-4b81-8a73-6cf3f5c2cac4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:15.465713 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0dd6ab67-6ec7-4b81-8a73-6cf3f5c2cac4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:15.466588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0dd6ab67-6ec7-4b81-8a73-6cf3f5c2cac4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:15.467076 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0dd6ab67-6ec7-4b81-8a73-6cf3f5c2cac4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:15.536774 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0dd6ab67-6ec7-4b81-8a73-6cf3f5c2cac4 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/8c82cb07-0c8f-4e22-820a-b7f9b7c4845d" status: 200 len: 194 microversion: 2.1 time: 0.085143 Apr 21 14:52:15.537436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 559/1185] 10.222.0.24 () {58 vars in 1403 bytes} [Wed Apr 21 14:52:15 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/8c82cb07-0c8f-4e22-820a-b7f9b7c4845d => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:15.551745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-004c8e9f-a0f8-4426-b0a9-fd6d6e878348 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:15.552398 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-004c8e9f-a0f8-4426-b0a9-fd6d6e878348 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:15.561013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-004c8e9f-a0f8-4426-b0a9-fd6d6e878348 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:15.561525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-004c8e9f-a0f8-4426-b0a9-fd6d6e878348 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:15.562441 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-004c8e9f-a0f8-4426-b0a9-fd6d6e878348 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:15.562933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-004c8e9f-a0f8-4426-b0a9-fd6d6e878348 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:15.748132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-004c8e9f-a0f8-4426-b0a9-fd6d6e878348 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lazy-loading 'services' on Instance uuid 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:52:15.899207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-004c8e9f-a0f8-4426-b0a9-fd6d6e878348 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "DELETE /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/8c82cb07-0c8f-4e22-820a-b7f9b7c4845d" status: 202 len: 0 microversion: 2.1 time: 0.351922 Apr 21 14:52:15.900144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 627/1186] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:52:15 2021] DELETE /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73/os-volume_attachments/8c82cb07-0c8f-4e22-820a-b7f9b7c4845d => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:52:17.531186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-14d85c2b-fd4a-4a01-af44-49d4bcb5f3ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:17.532043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-14d85c2b-fd4a-4a01-af44-49d4bcb5f3ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:17.544004 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14d85c2b-fd4a-4a01-af44-49d4bcb5f3ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:17.544493 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14d85c2b-fd4a-4a01-af44-49d4bcb5f3ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:17.545329 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14d85c2b-fd4a-4a01-af44-49d4bcb5f3ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:17.545815 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14d85c2b-fd4a-4a01-af44-49d4bcb5f3ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:17.611343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-14d85c2b-fd4a-4a01-af44-49d4bcb5f3ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:52:17.743198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-14d85c2b-fd4a-4a01-af44-49d4bcb5f3ce tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "DELETE /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 204 len: 0 microversion: 2.1 time: 0.218693 Apr 21 14:52:17.743947 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 560/1187] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:52:17 2021] DELETE /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:52:17.757550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-961f29e8-9f4e-4fdf-af24-769eb75ff5c0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:17.758726 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-961f29e8-9f4e-4fdf-af24-769eb75ff5c0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:17.768556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-961f29e8-9f4e-4fdf-af24-769eb75ff5c0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:17.769093 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-961f29e8-9f4e-4fdf-af24-769eb75ff5c0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:17.769917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-961f29e8-9f4e-4fdf-af24-769eb75ff5c0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:17.770447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-961f29e8-9f4e-4fdf-af24-769eb75ff5c0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:18.010791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-961f29e8-9f4e-4fdf-af24-769eb75ff5c0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:18.020737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-961f29e8-9f4e-4fdf-af24-769eb75ff5c0 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1674 microversion: 2.1 time: 0.271090 Apr 21 14:52:18.021425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 628/1188] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:17 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1674 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:19.044461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-20dcff13-ac1b-44f7-80be-78a6d41b9646 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:19.045677 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-20dcff13-ac1b-44f7-80be-78a6d41b9646 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:19.059460 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20dcff13-ac1b-44f7-80be-78a6d41b9646 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:19.060203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20dcff13-ac1b-44f7-80be-78a6d41b9646 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:19.061032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20dcff13-ac1b-44f7-80be-78a6d41b9646 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:19.061515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20dcff13-ac1b-44f7-80be-78a6d41b9646 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:19.293175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-20dcff13-ac1b-44f7-80be-78a6d41b9646 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:19.303380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-20dcff13-ac1b-44f7-80be-78a6d41b9646 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1674 microversion: 2.1 time: 0.266605 Apr 21 14:52:19.304011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 561/1189] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:19 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1674 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:20.321980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b93ac10f-552e-4042-b548-47adbf3ac2b8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:20.322603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b93ac10f-552e-4042-b548-47adbf3ac2b8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:20.331179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b93ac10f-552e-4042-b548-47adbf3ac2b8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:20.331680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b93ac10f-552e-4042-b548-47adbf3ac2b8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:20.332513 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b93ac10f-552e-4042-b548-47adbf3ac2b8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:20.332997 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b93ac10f-552e-4042-b548-47adbf3ac2b8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:20.548487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b93ac10f-552e-4042-b548-47adbf3ac2b8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:20.558757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b93ac10f-552e-4042-b548-47adbf3ac2b8 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1674 microversion: 2.1 time: 0.240798 Apr 21 14:52:20.559411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 629/1190] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:20 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1674 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:21.577214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-d1bc3183-26be-4e66-9d2f-83ce1b8b56e1 req-91f55b3d-ad5e-4c2f-97b4-3adcdeb48f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e0a0a8-1304-45b9-9f97-c2b4dea75e73", "name": "network-vif-deleted", "tag": "6d317d01-4d38-41ae-a496-0f075551f3b8"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:52:21.577759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ffe3d27b-8e92-4a1f-a95f-8ca27fae51ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:21.577930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ffe3d27b-8e92-4a1f-a95f-8ca27fae51ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:21.579057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:52:21.579057 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:52:21.588336 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe3d27b-8e92-4a1f-a95f-8ca27fae51ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:21.589022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d1bc3183-26be-4e66-9d2f-83ce1b8b56e1 req-91f55b3d-ad5e-4c2f-97b4-3adcdeb48f72 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:21.589367 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe3d27b-8e92-4a1f-a95f-8ca27fae51ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:21.590055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d1bc3183-26be-4e66-9d2f-83ce1b8b56e1 req-91f55b3d-ad5e-4c2f-97b4-3adcdeb48f72 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:21.590269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe3d27b-8e92-4a1f-a95f-8ca27fae51ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:21.591016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe3d27b-8e92-4a1f-a95f-8ca27fae51ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:21.610351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-d1bc3183-26be-4e66-9d2f-83ce1b8b56e1 req-91f55b3d-ad5e-4c2f-97b4-3adcdeb48f72 service nova] Creating event network-vif-deleted:6d317d01-4d38-41ae-a496-0f075551f3b8 for instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 on hv-cinder-78638 Apr 21 14:52:21.616532 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-d1bc3183-26be-4e66-9d2f-83ce1b8b56e1 req-91f55b3d-ad5e-4c2f-97b4-3adcdeb48f72 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043212 Apr 21 14:52:21.617182 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 562/1191] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:52:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:21.740356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ffe3d27b-8e92-4a1f-a95f-8ca27fae51ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff00d9db5164c7e9c38bdace0cb94ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023f43db8e84313ace24e0426447810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:21.750165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ffe3d27b-8e92-4a1f-a95f-8ca27fae51ed tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 200 len: 1322 microversion: 2.1 time: 0.177212 Apr 21 14:52:21.751023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 630/1192] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:21 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:22.770231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dd4d9f6b-2172-4b57-adc5-335f8978c810 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:22.771277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dd4d9f6b-2172-4b57-adc5-335f8978c810 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:22.780025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd4d9f6b-2172-4b57-adc5-335f8978c810 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:22.780539 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd4d9f6b-2172-4b57-adc5-335f8978c810 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:22.781440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd4d9f6b-2172-4b57-adc5-335f8978c810 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:22.781915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd4d9f6b-2172-4b57-adc5-335f8978c810 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:22.836023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-dd4d9f6b-2172-4b57-adc5-335f8978c810 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] HTTP exception thrown: Instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 could not be found. Apr 21 14:52:22.836706 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dd4d9f6b-2172-4b57-adc5-335f8978c810 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Returning 404 to user: Instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:52:22.837620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dd4d9f6b-2172-4b57-adc5-335f8978c810 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 404 len: 111 microversion: 2.1 time: 0.072355 Apr 21 14:52:22.838280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 563/1193] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:22 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:52:22.848488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b2f1d762-ce18-46a2-affd-0490c1c7c865 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '.version_select at 0x7f19def71158>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:22.866711 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b2f1d762-ce18-46a2-affd-0490c1c7c865 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604140834" status: 202 len: 0 microversion: 2.1 time: 0.022285 Apr 21 14:52:22.867333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 631/1194] 10.222.0.24 () {58 vars in 1208 bytes} [Wed Apr 21 14:52:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604140834 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:52:27.280646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3292caaa-adbc-4104-b49a-45734f545418 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:27.281229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3292caaa-adbc-4104-b49a-45734f545418 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:27.289672 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3292caaa-adbc-4104-b49a-45734f545418 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:27.290220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3292caaa-adbc-4104-b49a-45734f545418 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:27.291127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3292caaa-adbc-4104-b49a-45734f545418 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:27.291565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3292caaa-adbc-4104-b49a-45734f545418 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:27.360774 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3292caaa-adbc-4104-b49a-45734f545418 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:52:27.440845 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ffe3ff65-58d6-48a6-b173-2ebf96760f19 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:27.441439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ffe3ff65-58d6-48a6-b173-2ebf96760f19 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:27.450111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe3ff65-58d6-48a6-b173-2ebf96760f19 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:27.450875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe3ff65-58d6-48a6-b173-2ebf96760f19 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:27.451714 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe3ff65-58d6-48a6-b173-2ebf96760f19 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:27.452219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffe3ff65-58d6-48a6-b173-2ebf96760f19 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:27.482034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3292caaa-adbc-4104-b49a-45734f545418 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 204 len: 0 microversion: 2.1 time: 0.206366 Apr 21 14:52:27.482875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 564/1195] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:52:27 2021] DELETE /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:52:27.491788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34005b5d-12d8-4c75-a792-554a547387e8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:27.492588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34005b5d-12d8-4c75-a792-554a547387e8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:27.500681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34005b5d-12d8-4c75-a792-554a547387e8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:27.501190 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34005b5d-12d8-4c75-a792-554a547387e8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:27.502041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34005b5d-12d8-4c75-a792-554a547387e8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:27.502553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34005b5d-12d8-4c75-a792-554a547387e8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:27.509453 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-ffe3ff65-58d6-48a6-b173-2ebf96760f19 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] HTTP exception thrown: Instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 could not be found. Apr 21 14:52:27.510162 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ffe3ff65-58d6-48a6-b173-2ebf96760f19 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Returning 404 to user: Instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:52:27.511077 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ffe3ff65-58d6-48a6-b173-2ebf96760f19 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "DELETE /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 404 len: 111 microversion: 2.1 time: 0.074935 Apr 21 14:52:27.511694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 632/1196] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:52:27 2021] DELETE /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:52:27.520338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d4fab07f-03ac-43b3-9cdb-c72232ef14ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:27.521064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d4fab07f-03ac-43b3-9cdb-c72232ef14ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: 17e0a0a8-1304-45b9-9f97-c2b4dea75e73] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:27.529772 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4fab07f-03ac-43b3-9cdb-c72232ef14ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:27.530311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4fab07f-03ac-43b3-9cdb-c72232ef14ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:27.531144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4fab07f-03ac-43b3-9cdb-c72232ef14ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:27.531631 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4fab07f-03ac-43b3-9cdb-c72232ef14ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:27.726800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-d4fab07f-03ac-43b3-9cdb-c72232ef14ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] HTTP exception thrown: Instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 could not be found. Apr 21 14:52:27.727494 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d4fab07f-03ac-43b3-9cdb-c72232ef14ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Returning 404 to user: Instance 17e0a0a8-1304-45b9-9f97-c2b4dea75e73 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:52:27.728406 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d4fab07f-03ac-43b3-9cdb-c72232ef14ca tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73" status: 404 len: 111 microversion: 2.1 time: 0.212013 Apr 21 14:52:27.729025 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 633/1197] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:27 2021] GET /compute/v2.1/servers/17e0a0a8-1304-45b9-9f97-c2b4dea75e73 => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 21 14:52:27.733619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-34005b5d-12d8-4c75-a792-554a547387e8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:27.742889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34005b5d-12d8-4c75-a792-554a547387e8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1577 microversion: 2.1 time: 0.255520 Apr 21 14:52:27.743531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 565/1198] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:27 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1577 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:52:28.762592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c24ad375-37a0-40e1-878f-751a746e44fd tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:28.763484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c24ad375-37a0-40e1-878f-751a746e44fd tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:28.771549 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c24ad375-37a0-40e1-878f-751a746e44fd tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:28.772066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c24ad375-37a0-40e1-878f-751a746e44fd tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:28.772911 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c24ad375-37a0-40e1-878f-751a746e44fd tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:28.773410 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c24ad375-37a0-40e1-878f-751a746e44fd tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:28.992779 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fdd50ec4-1836-43f4-b072-165d0451ef82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:28.993435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fdd50ec4-1836-43f4-b072-165d0451ef82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:29.001872 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdd50ec4-1836-43f4-b072-165d0451ef82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:29.002536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdd50ec4-1836-43f4-b072-165d0451ef82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:29.003461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdd50ec4-1836-43f4-b072-165d0451ef82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:29.004032 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdd50ec4-1836-43f4-b072-165d0451ef82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:29.008274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c24ad375-37a0-40e1-878f-751a746e44fd tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:29.018431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c24ad375-37a0-40e1-878f-751a746e44fd tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1577 microversion: 2.1 time: 0.260812 Apr 21 14:52:29.019197 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 634/1199] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:28 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1577 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:29.058848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-fdd50ec4-1836-43f4-b072-165d0451ef82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] HTTP exception thrown: Instance eb0ca663-e263-49ed-b0c6-874b504da2e3 could not be found. Apr 21 14:52:29.059550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fdd50ec4-1836-43f4-b072-165d0451ef82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Returning 404 to user: Instance eb0ca663-e263-49ed-b0c6-874b504da2e3 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:52:29.060469 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fdd50ec4-1836-43f4-b072-165d0451ef82 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "DELETE /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 404 len: 111 microversion: 2.1 time: 0.071897 Apr 21 14:52:29.061099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 566/1200] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:52:28 2021] DELETE /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:52:29.074268 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8f22f944-f753-46ec-bb26-7c1535486f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:29.075320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8f22f944-f753-46ec-bb26-7c1535486f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] [instance: eb0ca663-e263-49ed-b0c6-874b504da2e3] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:29.083344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f22f944-f753-46ec-bb26-7c1535486f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:29.083840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f22f944-f753-46ec-bb26-7c1535486f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:29.084660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f22f944-f753-46ec-bb26-7c1535486f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:29.085138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8f22f944-f753-46ec-bb26-7c1535486f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:29.140658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-8f22f944-f753-46ec-bb26-7c1535486f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] HTTP exception thrown: Instance eb0ca663-e263-49ed-b0c6-874b504da2e3 could not be found. Apr 21 14:52:29.141316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8f22f944-f753-46ec-bb26-7c1535486f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] Returning 404 to user: Instance eb0ca663-e263-49ed-b0c6-874b504da2e3 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:52:29.142269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8f22f944-f753-46ec-bb26-7c1535486f12 tempest-AttachVolumeTestJSON-2109482274 tempest-AttachVolumeTestJSON-2109482274-project] 10.222.0.24 "GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3" status: 404 len: 111 microversion: 2.1 time: 0.074680 Apr 21 14:52:29.142883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 635/1201] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:29 2021] GET /compute/v2.1/servers/eb0ca663-e263-49ed-b0c6-874b504da2e3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:52:30.037340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5ebdbac4-8b45-4ea4-a788-ff983665db76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:30.037958 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5ebdbac4-8b45-4ea4-a788-ff983665db76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:30.047316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ebdbac4-8b45-4ea4-a788-ff983665db76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:30.047759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ebdbac4-8b45-4ea4-a788-ff983665db76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:30.048794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ebdbac4-8b45-4ea4-a788-ff983665db76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:30.049594 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ebdbac4-8b45-4ea4-a788-ff983665db76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:30.298284 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5ebdbac4-8b45-4ea4-a788-ff983665db76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:30.308064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5ebdbac4-8b45-4ea4-a788-ff983665db76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1510 microversion: 2.1 time: 0.274699 Apr 21 14:52:30.308962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 567/1202] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:30 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:30.675384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-00499a81-0271-4c8f-8178-f3d47fd23679 req-2b6f6a1c-4064-4c84-9b29-3ccee465140d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b886ca0-c1b7-4e12-a979-b3ddf5b77f58", "name": "network-vif-deleted", "tag": "edae6881-37a1-437a-a77d-c55e80187a50"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:52:30.677625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:52:30.677625 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:52:30.687021 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-00499a81-0271-4c8f-8178-f3d47fd23679 req-2b6f6a1c-4064-4c84-9b29-3ccee465140d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:30.687473 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-00499a81-0271-4c8f-8178-f3d47fd23679 req-2b6f6a1c-4064-4c84-9b29-3ccee465140d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:30.719511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-00499a81-0271-4c8f-8178-f3d47fd23679 req-2b6f6a1c-4064-4c84-9b29-3ccee465140d service nova] Creating event network-vif-deleted:edae6881-37a1-437a-a77d-c55e80187a50 for instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 on hv-cinder-78638 Apr 21 14:52:30.725935 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-00499a81-0271-4c8f-8178-f3d47fd23679 req-2b6f6a1c-4064-4c84-9b29-3ccee465140d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054448 Apr 21 14:52:30.726397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 636/1203] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:52:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:31.326975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:31.327985 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:31.336260 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:31.336771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:31.337657 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:31.338187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:31.413868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:31.414410 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:31.414914 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lazy-loading 'fault' on Instance uuid 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:52:31.505890 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:31.520897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-29b1033b-4f47-4eff-9d2e-aa5eae1a1741 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 200 len: 1230 microversion: 2.1 time: 0.197888 Apr 21 14:52:31.533020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 568/1204] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:31 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 1230 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:32.543183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-de0207a7-42db-489b-ba45-8a29b309c25f tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:32.544854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-de0207a7-42db-489b-ba45-8a29b309c25f tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:32.564194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de0207a7-42db-489b-ba45-8a29b309c25f tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:32.564712 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de0207a7-42db-489b-ba45-8a29b309c25f tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:32.565588 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de0207a7-42db-489b-ba45-8a29b309c25f tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:32.566115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de0207a7-42db-489b-ba45-8a29b309c25f tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:32.626365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-de0207a7-42db-489b-ba45-8a29b309c25f tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] HTTP exception thrown: Instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 could not be found. Apr 21 14:52:32.627048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-de0207a7-42db-489b-ba45-8a29b309c25f tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Returning 404 to user: Instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:52:32.627948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-de0207a7-42db-489b-ba45-8a29b309c25f tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 404 len: 111 microversion: 2.1 time: 0.090602 Apr 21 14:52:32.628733 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 637/1205] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:32 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:52:32.750144 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1512298144", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1319973046", "security_groups": [{"name": "tempest-secgroup-smoke-222957663"}], "block_device_mapping_v2": [{"uuid": "27644a17-ae07-48e3-a2a8-ea3f15a28f03", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bf02896-5a06-4820-afef-e1d155642dab"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:52:32.932011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] validate_networks() for [('3bf02896-5a06-4820-afef-e1d155642dab', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:52:33.876646 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:52:33.877088 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:52:33.877850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:52:33.878427 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:52:33.878963 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:52:33.888366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:33.888961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:33.889901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:33.890502 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:33.911978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for project 47f31a5650834e49b288140b0ca768c2. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:52:33.917254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for user c134d419e09b4f7da63a8401c01bf6b3 and project 47f31a5650834e49b288140b0ca768c2. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:52:34.038298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:52:34.040912 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27644a17-ae07-48e3-a2a8-ea3f15a28f03',volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:52:34.234138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-03939626-99d5-4fd3-b5cc-c74ca02f9093 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.487983 Apr 21 14:52:34.235729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 569/1206] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:52:32 2021] POST /compute/v2.1/servers => generated 405 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:52:34.249105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-328d5048-79d4-4c42-9d7a-da1106d530d8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:34.251540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-328d5048-79d4-4c42-9d7a-da1106d530d8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:34.347357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-328d5048-79d4-4c42-9d7a-da1106d530d8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:34.355856 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-328d5048-79d4-4c42-9d7a-da1106d530d8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1095 microversion: 2.1 time: 0.113089 Apr 21 14:52:34.356435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 638/1207] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:34 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1095 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:35.373306 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0477b209-3fb0-4756-b869-e97f9840c325 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:35.374660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0477b209-3fb0-4756-b869-e97f9840c325 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:35.383839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0477b209-3fb0-4756-b869-e97f9840c325 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:35.384611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0477b209-3fb0-4756-b869-e97f9840c325 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:35.385618 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0477b209-3fb0-4756-b869-e97f9840c325 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:35.386357 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0477b209-3fb0-4756-b869-e97f9840c325 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:35.538597 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0477b209-3fb0-4756-b869-e97f9840c325 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:35.550573 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0477b209-3fb0-4756-b869-e97f9840c325 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1211 microversion: 2.1 time: 0.180531 Apr 21 14:52:35.551229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 570/1208] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:35 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1211 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:36.569218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cb38903b-dade-4bfc-925f-5a0f6494938b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:36.570703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cb38903b-dade-4bfc-925f-5a0f6494938b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:36.588105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb38903b-dade-4bfc-925f-5a0f6494938b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:36.590470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb38903b-dade-4bfc-925f-5a0f6494938b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:36.592013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb38903b-dade-4bfc-925f-5a0f6494938b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:36.592828 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb38903b-dade-4bfc-925f-5a0f6494938b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:36.832574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cb38903b-dade-4bfc-925f-5a0f6494938b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:36.843463 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cb38903b-dade-4bfc-925f-5a0f6494938b tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.278303 Apr 21 14:52:36.844093 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 639/1209] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:36 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:37.485509 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-5e969c9e-30f0-40a4-ab1c-2e4768c88e50 req-6c5177ce-2366-4905-a99e-16f732e2e454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cac6e3-c70e-4a55-aec4-72689e662fc5", "tag": "9f462ccd-688b-4a79-8d55-7cf72be7aeb0"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:52:37.487327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:52:37.487327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:52:37.497115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-5e969c9e-30f0-40a4-ab1c-2e4768c88e50 req-6c5177ce-2366-4905-a99e-16f732e2e454 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:37.497889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-5e969c9e-30f0-40a4-ab1c-2e4768c88e50 req-6c5177ce-2366-4905-a99e-16f732e2e454 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:37.519056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-5e969c9e-30f0-40a4-ab1c-2e4768c88e50 req-6c5177ce-2366-4905-a99e-16f732e2e454 service nova] Creating event network-changed:9f462ccd-688b-4a79-8d55-7cf72be7aeb0 for instance d8cac6e3-c70e-4a55-aec4-72689e662fc5 on hv-cinder-78638 Apr 21 14:52:37.526515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-5e969c9e-30f0-40a4-ab1c-2e4768c88e50 req-6c5177ce-2366-4905-a99e-16f732e2e454 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044671 Apr 21 14:52:37.527617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 571/1210] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:52:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:37.861807 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-780392dc-ee6c-4fea-8909-2f76f6b0e9ea tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:37.862747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-780392dc-ee6c-4fea-8909-2f76f6b0e9ea tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:37.871515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-780392dc-ee6c-4fea-8909-2f76f6b0e9ea tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:37.872101 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-780392dc-ee6c-4fea-8909-2f76f6b0e9ea tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:37.872941 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-780392dc-ee6c-4fea-8909-2f76f6b0e9ea tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:37.873429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-780392dc-ee6c-4fea-8909-2f76f6b0e9ea tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:38.106468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-780392dc-ee6c-4fea-8909-2f76f6b0e9ea tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:38.116287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-780392dc-ee6c-4fea-8909-2f76f6b0e9ea tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.259051 Apr 21 14:52:38.116932 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 640/1211] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:37 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:39.136624 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-85f4dfaf-8998-4839-a44a-b1b78960c26a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:39.138292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-85f4dfaf-8998-4839-a44a-b1b78960c26a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:39.146439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85f4dfaf-8998-4839-a44a-b1b78960c26a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:39.146952 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85f4dfaf-8998-4839-a44a-b1b78960c26a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:39.147783 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85f4dfaf-8998-4839-a44a-b1b78960c26a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:39.148281 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85f4dfaf-8998-4839-a44a-b1b78960c26a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:39.389220 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-85f4dfaf-8998-4839-a44a-b1b78960c26a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:39.398580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-85f4dfaf-8998-4839-a44a-b1b78960c26a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.267304 Apr 21 14:52:39.399251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 572/1212] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:39 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:40.417122 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-513e11b0-7c15-45d9-9fc3-e339139fcda9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:40.417930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-513e11b0-7c15-45d9-9fc3-e339139fcda9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:40.426757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-513e11b0-7c15-45d9-9fc3-e339139fcda9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:40.427267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-513e11b0-7c15-45d9-9fc3-e339139fcda9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:40.428116 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-513e11b0-7c15-45d9-9fc3-e339139fcda9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:40.428607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-513e11b0-7c15-45d9-9fc3-e339139fcda9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:40.747040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-513e11b0-7c15-45d9-9fc3-e339139fcda9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:40.756561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-513e11b0-7c15-45d9-9fc3-e339139fcda9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.343623 Apr 21 14:52:40.757225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 641/1213] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:40 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:41.775229 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-43a79584-6143-4a81-bd52-e3e503d71140 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:41.775945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-43a79584-6143-4a81-bd52-e3e503d71140 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:41.785102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43a79584-6143-4a81-bd52-e3e503d71140 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:41.785649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43a79584-6143-4a81-bd52-e3e503d71140 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:41.786536 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43a79584-6143-4a81-bd52-e3e503d71140 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:41.787038 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43a79584-6143-4a81-bd52-e3e503d71140 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:42.021759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-43a79584-6143-4a81-bd52-e3e503d71140 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:42.031035 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-43a79584-6143-4a81-bd52-e3e503d71140 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.259931 Apr 21 14:52:42.031763 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 573/1214] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:41 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:43.050017 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-386b579c-49ec-42fa-99ac-cc627184f380 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:43.050701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-386b579c-49ec-42fa-99ac-cc627184f380 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:43.059269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-386b579c-49ec-42fa-99ac-cc627184f380 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:43.059787 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-386b579c-49ec-42fa-99ac-cc627184f380 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:43.060635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-386b579c-49ec-42fa-99ac-cc627184f380 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:43.061120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-386b579c-49ec-42fa-99ac-cc627184f380 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:43.555274 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-386b579c-49ec-42fa-99ac-cc627184f380 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:43.565610 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-386b579c-49ec-42fa-99ac-cc627184f380 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.520202 Apr 21 14:52:43.566251 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 642/1215] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:43 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:44.584535 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-22134632-f97b-43a8-8246-b640f70c1a43 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:44.585207 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-22134632-f97b-43a8-8246-b640f70c1a43 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:44.593961 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22134632-f97b-43a8-8246-b640f70c1a43 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:44.594505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22134632-f97b-43a8-8246-b640f70c1a43 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:44.595343 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22134632-f97b-43a8-8246-b640f70c1a43 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:44.595838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22134632-f97b-43a8-8246-b640f70c1a43 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:44.831135 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-22134632-f97b-43a8-8246-b640f70c1a43 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:44.841127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-22134632-f97b-43a8-8246-b640f70c1a43 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.260763 Apr 21 14:52:44.841775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 574/1216] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:44 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:45.860461 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34b20400-c450-409d-845e-06c3802e4421 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:45.861136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34b20400-c450-409d-845e-06c3802e4421 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:45.869680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34b20400-c450-409d-845e-06c3802e4421 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:45.870186 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34b20400-c450-409d-845e-06c3802e4421 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:45.871023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34b20400-c450-409d-845e-06c3802e4421 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:45.871564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34b20400-c450-409d-845e-06c3802e4421 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:46.120375 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-34b20400-c450-409d-845e-06c3802e4421 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:46.129960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34b20400-c450-409d-845e-06c3802e4421 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.273707 Apr 21 14:52:46.130616 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 643/1217] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:45 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:47.149480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b9c60030-e89e-4e06-905c-f8ec37ecdd63 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:47.150203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b9c60030-e89e-4e06-905c-f8ec37ecdd63 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:47.159574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9c60030-e89e-4e06-905c-f8ec37ecdd63 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:47.160084 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9c60030-e89e-4e06-905c-f8ec37ecdd63 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:47.160960 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9c60030-e89e-4e06-905c-f8ec37ecdd63 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:47.161454 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9c60030-e89e-4e06-905c-f8ec37ecdd63 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:47.648275 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b9c60030-e89e-4e06-905c-f8ec37ecdd63 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:47.658758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b9c60030-e89e-4e06-905c-f8ec37ecdd63 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.513516 Apr 21 14:52:47.659444 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 575/1218] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:47 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:48.140751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-2c8d596e-247b-463c-a9d7-4dedb5ccfbb3 req-186e84f0-e302-42b2-a57a-7c3dbea3ff6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cac6e3-c70e-4a55-aec4-72689e662fc5", "name": "network-vif-plugged", "status": "completed", "tag": "9f462ccd-688b-4a79-8d55-7cf72be7aeb0"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:52:48.142563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:52:48.142563 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:52:48.152137 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2c8d596e-247b-463c-a9d7-4dedb5ccfbb3 req-186e84f0-e302-42b2-a57a-7c3dbea3ff6f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:48.152777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2c8d596e-247b-463c-a9d7-4dedb5ccfbb3 req-186e84f0-e302-42b2-a57a-7c3dbea3ff6f service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:48.171052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-2c8d596e-247b-463c-a9d7-4dedb5ccfbb3 req-186e84f0-e302-42b2-a57a-7c3dbea3ff6f service nova] Creating event network-vif-plugged:9f462ccd-688b-4a79-8d55-7cf72be7aeb0 for instance d8cac6e3-c70e-4a55-aec4-72689e662fc5 on hv-cinder-78638 Apr 21 14:52:48.176770 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-2c8d596e-247b-463c-a9d7-4dedb5ccfbb3 req-186e84f0-e302-42b2-a57a-7c3dbea3ff6f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220937 Apr 21 14:52:48.177470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 644/1219] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:52:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:52:48.678315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a2b00f50-caf2-4686-b200-1ef7fd7598aa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:48.678986 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a2b00f50-caf2-4686-b200-1ef7fd7598aa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:48.688105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2b00f50-caf2-4686-b200-1ef7fd7598aa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:48.688620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2b00f50-caf2-4686-b200-1ef7fd7598aa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:48.689483 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2b00f50-caf2-4686-b200-1ef7fd7598aa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:48.689976 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2b00f50-caf2-4686-b200-1ef7fd7598aa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:48.952810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a2b00f50-caf2-4686-b200-1ef7fd7598aa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:48.962805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a2b00f50-caf2-4686-b200-1ef7fd7598aa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1266 microversion: 2.1 time: 0.289205 Apr 21 14:52:48.963791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 576/1220] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:48 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:49.982196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-49107d50-83c5-473e-8c6a-6b6f75d53a76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:49.983272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-49107d50-83c5-473e-8c6a-6b6f75d53a76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:49.992233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49107d50-83c5-473e-8c6a-6b6f75d53a76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:49.992929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49107d50-83c5-473e-8c6a-6b6f75d53a76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:49.993752 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49107d50-83c5-473e-8c6a-6b6f75d53a76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:49.994293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-49107d50-83c5-473e-8c6a-6b6f75d53a76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:50.282661 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-49107d50-83c5-473e-8c6a-6b6f75d53a76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:50.294720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-49107d50-83c5-473e-8c6a-6b6f75d53a76 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1454 microversion: 2.1 time: 0.317048 Apr 21 14:52:50.295566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 645/1221] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:49 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1454 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:50.314007 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-16342c21-6d90-4291-aa26-ac5bff38917d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:52:50.314720 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-16342c21-6d90-4291-aa26-ac5bff38917d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:52:50.323689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16342c21-6d90-4291-aa26-ac5bff38917d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:50.324236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16342c21-6d90-4291-aa26-ac5bff38917d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:50.325168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16342c21-6d90-4291-aa26-ac5bff38917d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:50.325660 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16342c21-6d90-4291-aa26-ac5bff38917d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:50.588875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-16342c21-6d90-4291-aa26-ac5bff38917d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:52:50.599035 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-16342c21-6d90-4291-aa26-ac5bff38917d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1454 microversion: 2.1 time: 0.290205 Apr 21 14:52:50.599719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 577/1222] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:52:50 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1454 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:52:53.454424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-244eeaab-c4ae-4eed-81fc-0de604f09595 req-78d1fd56-c445-473e-95ff-5223bc025585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cac6e3-c70e-4a55-aec4-72689e662fc5", "tag": "9f462ccd-688b-4a79-8d55-7cf72be7aeb0"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:52:53.456138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:52:53.456138 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:52:53.475771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-244eeaab-c4ae-4eed-81fc-0de604f09595 req-78d1fd56-c445-473e-95ff-5223bc025585 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:52:53.476376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-244eeaab-c4ae-4eed-81fc-0de604f09595 req-78d1fd56-c445-473e-95ff-5223bc025585 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:52:53.495359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-244eeaab-c4ae-4eed-81fc-0de604f09595 req-78d1fd56-c445-473e-95ff-5223bc025585 service nova] Creating event network-changed:9f462ccd-688b-4a79-8d55-7cf72be7aeb0 for instance d8cac6e3-c70e-4a55-aec4-72689e662fc5 on hv-cinder-78638 Apr 21 14:52:53.501196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-244eeaab-c4ae-4eed-81fc-0de604f09595 req-78d1fd56-c445-473e-95ff-5223bc025585 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286578 Apr 21 14:52:53.502049 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 646/1223] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:52:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:54:19.218042 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfdb13b7-7bc2-4d12-9faf-2455bd328414] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 14:54:19.221751 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b70c7b15-6397-421c-b04a-725e9dea21c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Action: 'create', calling method: .version_select at 0x7f19de61ec80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2090011206"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:54:19.245414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-b70c7b15-6397-421c-b04a-725e9dea21c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Getting quotas for project 0e1ab995c213484f9e8260545de2fad5. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:54:19.249717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-b70c7b15-6397-421c-b04a-725e9dea21c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Getting quotas for user 03c2a31b513f4706bf4aab6c9cfc94cb and project 0e1ab995c213484f9e8260545de2fad5. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:54:19.746302 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-b70c7b15-6397-421c-b04a-725e9dea21c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Getting quotas for project 0e1ab995c213484f9e8260545de2fad5. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:54:19.750606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-b70c7b15-6397-421c-b04a-725e9dea21c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Getting quotas for user 03c2a31b513f4706bf4aab6c9cfc94cb and project 0e1ab995c213484f9e8260545de2fad5. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:54:19.764372 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b70c7b15-6397-421c-b04a-725e9dea21c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.547922 Apr 21 14:54:19.765060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 578/1224] 10.222.0.24 () {60 vars in 1148 bytes} [Wed Apr 21 14:54:19 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:19.824359 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1151372136", "imageRef": "deba14d6-f4a3-41ce-b36e-6fcf84a8de5a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2090011206", "networks": [{"uuid": "871608a8-9514-4d58-92e6-53fbe8d173c2"}]}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:54:20.025292 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] validate_networks() for [('871608a8-9514-4d58-92e6-53fbe8d173c2', None, None, None)] {{(pid=100564) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:54:20.658254 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Flavor limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:54:20.658780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Image limits 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:54:20.659325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Flavor pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:54:20.659989 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Image pref 0:0:0 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:54:20.660522 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:54:20.670389 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:20.670899 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:20.671806 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:20.672296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:20.691859 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Getting quotas for project 0e1ab995c213484f9e8260545de2fad5. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:54:20.696331 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Getting quotas for user 03c2a31b513f4706bf4aab6c9cfc94cb and project 0e1ab995c213484f9e8260545de2fad5. Resources: {'cores', 'instances', 'ram'} {{(pid=100564) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:54:20.708295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Going to run 1 instances... {{(pid=100564) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:54:20.711000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='deba14d6-f4a3-41ce-b36e-6fcf84a8de5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:54:20.764971 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-48edc85f-5faf-47fe-a384-11fe72f52745 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945176 Apr 21 14:54:20.765577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 647/1225] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:54:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:54:20.776545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3260b8be-7014-4f90-a552-e1c5632d5ebb tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:20.777311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3260b8be-7014-4f90-a552-e1c5632d5ebb tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:20.803245 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfdb13b7-7bc2-4d12-9faf-2455bd328414] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 37646. Apr 21 14:54:20.999302 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3260b8be-7014-4f90-a552-e1c5632d5ebb tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:21.008265 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3260b8be-7014-4f90-a552-e1c5632d5ebb tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1259 microversion: 2.1 time: 0.235890 Apr 21 14:54:21.009102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 579/1226] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:20 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:22.026884 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-059800f2-ca18-4366-9b64-2d5f9a02dc07 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:22.028524 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-059800f2-ca18-4366-9b64-2d5f9a02dc07 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:22.038067 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-059800f2-ca18-4366-9b64-2d5f9a02dc07 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:22.038585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-059800f2-ca18-4366-9b64-2d5f9a02dc07 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:22.039561 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-059800f2-ca18-4366-9b64-2d5f9a02dc07 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:22.039975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-059800f2-ca18-4366-9b64-2d5f9a02dc07 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:22.455356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-059800f2-ca18-4366-9b64-2d5f9a02dc07 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:22.465403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-059800f2-ca18-4366-9b64-2d5f9a02dc07 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1319 microversion: 2.1 time: 0.442586 Apr 21 14:54:22.466341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 648/1227] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:22 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:23.485252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-56b3969d-2cc8-42cf-b21f-48507b3a4a53 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:23.486603 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-56b3969d-2cc8-42cf-b21f-48507b3a4a53 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:23.495413 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56b3969d-2cc8-42cf-b21f-48507b3a4a53 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:23.496184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56b3969d-2cc8-42cf-b21f-48507b3a4a53 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:23.497212 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56b3969d-2cc8-42cf-b21f-48507b3a4a53 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:23.497860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56b3969d-2cc8-42cf-b21f-48507b3a4a53 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:23.751208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-56b3969d-2cc8-42cf-b21f-48507b3a4a53 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:23.760405 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-56b3969d-2cc8-42cf-b21f-48507b3a4a53 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.279490 Apr 21 14:54:23.761429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 580/1228] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:23 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:24.779875 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a4ed8a83-5e72-40a9-968a-0f34de7c4177 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:24.780550 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a4ed8a83-5e72-40a9-968a-0f34de7c4177 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:24.788910 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4ed8a83-5e72-40a9-968a-0f34de7c4177 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:24.789411 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4ed8a83-5e72-40a9-968a-0f34de7c4177 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:24.790280 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4ed8a83-5e72-40a9-968a-0f34de7c4177 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:24.790806 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4ed8a83-5e72-40a9-968a-0f34de7c4177 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:25.045922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a4ed8a83-5e72-40a9-968a-0f34de7c4177 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:25.058745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a4ed8a83-5e72-40a9-968a-0f34de7c4177 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.282845 Apr 21 14:54:25.059369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 649/1229] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:24 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:26.078642 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b89ed0ca-637f-4a08-bee0-62cae86c96df tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:26.079366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b89ed0ca-637f-4a08-bee0-62cae86c96df tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:26.088806 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b89ed0ca-637f-4a08-bee0-62cae86c96df tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:26.089456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b89ed0ca-637f-4a08-bee0-62cae86c96df tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:26.090614 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b89ed0ca-637f-4a08-bee0-62cae86c96df tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:26.091364 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b89ed0ca-637f-4a08-bee0-62cae86c96df tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:26.317945 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b89ed0ca-637f-4a08-bee0-62cae86c96df tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:26.327222 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b89ed0ca-637f-4a08-bee0-62cae86c96df tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.253588 Apr 21 14:54:26.327930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 581/1230] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:26 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:27.346066 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1e4e73cc-57a4-4e54-9a85-c00b5478bfe1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:27.346619 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1e4e73cc-57a4-4e54-9a85-c00b5478bfe1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:27.355338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e4e73cc-57a4-4e54-9a85-c00b5478bfe1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:27.355846 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e4e73cc-57a4-4e54-9a85-c00b5478bfe1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:27.356689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e4e73cc-57a4-4e54-9a85-c00b5478bfe1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:27.357187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e4e73cc-57a4-4e54-9a85-c00b5478bfe1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:27.593417 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1e4e73cc-57a4-4e54-9a85-c00b5478bfe1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:27.602917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1e4e73cc-57a4-4e54-9a85-c00b5478bfe1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.260998 Apr 21 14:54:27.603481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 650/1231] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:27 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:28.621300 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9820f223-fbe6-4b2c-8f98-d98c32d677ee tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:28.621917 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9820f223-fbe6-4b2c-8f98-d98c32d677ee tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:28.630430 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9820f223-fbe6-4b2c-8f98-d98c32d677ee tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:28.630936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9820f223-fbe6-4b2c-8f98-d98c32d677ee tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:28.631760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9820f223-fbe6-4b2c-8f98-d98c32d677ee tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:28.632241 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9820f223-fbe6-4b2c-8f98-d98c32d677ee tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:29.148267 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9820f223-fbe6-4b2c-8f98-d98c32d677ee tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:29.160689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9820f223-fbe6-4b2c-8f98-d98c32d677ee tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.542625 Apr 21 14:54:29.161655 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 582/1232] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:28 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:30.181571 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a0626fa1-6c13-423b-8647-0b61031e5793 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:30.183176 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a0626fa1-6c13-423b-8647-0b61031e5793 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:30.191681 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0626fa1-6c13-423b-8647-0b61031e5793 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:30.193023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0626fa1-6c13-423b-8647-0b61031e5793 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:30.193159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0626fa1-6c13-423b-8647-0b61031e5793 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:30.193622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0626fa1-6c13-423b-8647-0b61031e5793 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:30.439250 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0626fa1-6c13-423b-8647-0b61031e5793 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:30.448296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a0626fa1-6c13-423b-8647-0b61031e5793 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.271507 Apr 21 14:54:30.448933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 651/1233] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:30 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:31.466843 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d689a5b0-5937-4c15-bd51-c5590c6abef1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:31.467636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d689a5b0-5937-4c15-bd51-c5590c6abef1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:31.476015 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d689a5b0-5937-4c15-bd51-c5590c6abef1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:31.476520 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d689a5b0-5937-4c15-bd51-c5590c6abef1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:31.477391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d689a5b0-5937-4c15-bd51-c5590c6abef1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:31.477888 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d689a5b0-5937-4c15-bd51-c5590c6abef1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:31.706893 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d689a5b0-5937-4c15-bd51-c5590c6abef1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:31.719293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d689a5b0-5937-4c15-bd51-c5590c6abef1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.255779 Apr 21 14:54:31.720611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 583/1234] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:31 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:32.740318 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3ed8fa4-a3e2-4c8e-a455-e048bfe57ff8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:32.741652 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a3ed8fa4-a3e2-4c8e-a455-e048bfe57ff8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:32.750382 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3ed8fa4-a3e2-4c8e-a455-e048bfe57ff8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:32.750868 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3ed8fa4-a3e2-4c8e-a455-e048bfe57ff8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:32.751704 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3ed8fa4-a3e2-4c8e-a455-e048bfe57ff8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:32.752187 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3ed8fa4-a3e2-4c8e-a455-e048bfe57ff8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:32.979309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a3ed8fa4-a3e2-4c8e-a455-e048bfe57ff8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:32.988940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a3ed8fa4-a3e2-4c8e-a455-e048bfe57ff8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.253377 Apr 21 14:54:32.989873 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 652/1235] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:32 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:34.007745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c6c6509f-4d32-4d93-b5bd-e4116872d480 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:34.008363 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c6c6509f-4d32-4d93-b5bd-e4116872d480 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:34.017236 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6c6509f-4d32-4d93-b5bd-e4116872d480 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:34.017746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6c6509f-4d32-4d93-b5bd-e4116872d480 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:34.018670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6c6509f-4d32-4d93-b5bd-e4116872d480 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:34.019788 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6c6509f-4d32-4d93-b5bd-e4116872d480 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:34.240022 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c6c6509f-4d32-4d93-b5bd-e4116872d480 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:34.251196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c6c6509f-4d32-4d93-b5bd-e4116872d480 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.247586 Apr 21 14:54:34.251848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 584/1236] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:34 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:35.270758 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fd452db9-e552-4d41-863d-8053fd47e1bc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:35.271623 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fd452db9-e552-4d41-863d-8053fd47e1bc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:35.280372 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd452db9-e552-4d41-863d-8053fd47e1bc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:35.280800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd452db9-e552-4d41-863d-8053fd47e1bc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:35.281650 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd452db9-e552-4d41-863d-8053fd47e1bc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:35.282184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd452db9-e552-4d41-863d-8053fd47e1bc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:35.499419 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fd452db9-e552-4d41-863d-8053fd47e1bc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:35.509429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fd452db9-e552-4d41-863d-8053fd47e1bc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.243171 Apr 21 14:54:35.510105 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 653/1237] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:35 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:36.528339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a41f9a0b-7e98-41eb-9f3c-86b20e11e6ae tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:36.529013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a41f9a0b-7e98-41eb-9f3c-86b20e11e6ae tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:36.538233 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a41f9a0b-7e98-41eb-9f3c-86b20e11e6ae tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:36.538749 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a41f9a0b-7e98-41eb-9f3c-86b20e11e6ae tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:36.539602 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a41f9a0b-7e98-41eb-9f3c-86b20e11e6ae tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:36.540094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a41f9a0b-7e98-41eb-9f3c-86b20e11e6ae tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:37.093126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a41f9a0b-7e98-41eb-9f3c-86b20e11e6ae tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:37.103803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a41f9a0b-7e98-41eb-9f3c-86b20e11e6ae tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.579589 Apr 21 14:54:37.104620 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 585/1238] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:36 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:37.195468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-682b0dac-ab67-4257-8e0b-0c3dad6cad72 req-1b547be3-23d5-4c28-bda0-0fdcdd53772d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831e6747-0fba-4087-a5c1-664af456a922", "tag": "0abca0b1-ade4-4453-a1f8-bec5e7c24c69"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:54:37.199607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:54:37.199607 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:54:37.228474 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-682b0dac-ab67-4257-8e0b-0c3dad6cad72 req-1b547be3-23d5-4c28-bda0-0fdcdd53772d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:37.229451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-682b0dac-ab67-4257-8e0b-0c3dad6cad72 req-1b547be3-23d5-4c28-bda0-0fdcdd53772d service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:37.251121 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-682b0dac-ab67-4257-8e0b-0c3dad6cad72 req-1b547be3-23d5-4c28-bda0-0fdcdd53772d service nova] Creating event network-changed:0abca0b1-ade4-4453-a1f8-bec5e7c24c69 for instance 831e6747-0fba-4087-a5c1-664af456a922 on hv-cinder-78638 Apr 21 14:54:37.256864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-682b0dac-ab67-4257-8e0b-0c3dad6cad72 req-1b547be3-23d5-4c28-bda0-0fdcdd53772d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070421 Apr 21 14:54:37.257855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 654/1239] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:54:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:54:38.126421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-deab2b8a-4598-4e1c-8e32-d1d614fa2c74 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:38.127323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-deab2b8a-4598-4e1c-8e32-d1d614fa2c74 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:38.139800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-deab2b8a-4598-4e1c-8e32-d1d614fa2c74 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:38.140655 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-deab2b8a-4598-4e1c-8e32-d1d614fa2c74 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:38.142016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-deab2b8a-4598-4e1c-8e32-d1d614fa2c74 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:38.142816 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-deab2b8a-4598-4e1c-8e32-d1d614fa2c74 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:38.566293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-deab2b8a-4598-4e1c-8e32-d1d614fa2c74 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:38.576316 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-deab2b8a-4598-4e1c-8e32-d1d614fa2c74 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.454906 Apr 21 14:54:38.577198 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 586/1240] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:38 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:39.597111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb8ab832-49fe-4b06-ac1f-a95fc908058f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:39.597883 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb8ab832-49fe-4b06-ac1f-a95fc908058f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:39.607179 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb8ab832-49fe-4b06-ac1f-a95fc908058f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:39.607689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb8ab832-49fe-4b06-ac1f-a95fc908058f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:39.608538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb8ab832-49fe-4b06-ac1f-a95fc908058f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:39.609036 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb8ab832-49fe-4b06-ac1f-a95fc908058f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:39.837808 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eb8ab832-49fe-4b06-ac1f-a95fc908058f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:39.847819 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb8ab832-49fe-4b06-ac1f-a95fc908058f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.255441 Apr 21 14:54:39.848373 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 655/1241] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:39 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:40.866742 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-21f18331-0c7b-45b1-bf5a-e3dc70e4160d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:40.867565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-21f18331-0c7b-45b1-bf5a-e3dc70e4160d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:40.876184 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21f18331-0c7b-45b1-bf5a-e3dc70e4160d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:40.876698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21f18331-0c7b-45b1-bf5a-e3dc70e4160d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:40.877570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21f18331-0c7b-45b1-bf5a-e3dc70e4160d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:40.878114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21f18331-0c7b-45b1-bf5a-e3dc70e4160d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:41.107680 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-21f18331-0c7b-45b1-bf5a-e3dc70e4160d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:41.117770 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-21f18331-0c7b-45b1-bf5a-e3dc70e4160d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.255289 Apr 21 14:54:41.118393 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 587/1242] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:40 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:42.139645 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eef5d6f3-5629-490c-887c-85a486e1cbb0 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:42.140346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eef5d6f3-5629-490c-887c-85a486e1cbb0 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:42.148793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eef5d6f3-5629-490c-887c-85a486e1cbb0 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:42.149303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eef5d6f3-5629-490c-887c-85a486e1cbb0 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:42.150166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eef5d6f3-5629-490c-887c-85a486e1cbb0 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:42.150685 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eef5d6f3-5629-490c-887c-85a486e1cbb0 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:42.371055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eef5d6f3-5629-490c-887c-85a486e1cbb0 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:42.380328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eef5d6f3-5629-490c-887c-85a486e1cbb0 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.247287 Apr 21 14:54:42.381005 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 656/1243] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:42 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:43.399426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-77bfe81d-22a7-4c86-a2aa-ae35b315e9f4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:43.400094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-77bfe81d-22a7-4c86-a2aa-ae35b315e9f4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:43.408540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77bfe81d-22a7-4c86-a2aa-ae35b315e9f4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:43.409043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77bfe81d-22a7-4c86-a2aa-ae35b315e9f4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:43.409876 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77bfe81d-22a7-4c86-a2aa-ae35b315e9f4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:43.410393 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77bfe81d-22a7-4c86-a2aa-ae35b315e9f4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:43.641358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-77bfe81d-22a7-4c86-a2aa-ae35b315e9f4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:43.651160 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-77bfe81d-22a7-4c86-a2aa-ae35b315e9f4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.255647 Apr 21 14:54:43.651852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 588/1244] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:43 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:44.453086 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-702c3453-512e-45da-ba69-63059fcaba1c req-ff149926-b665-4005-a22b-7ee4dfdd174b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831e6747-0fba-4087-a5c1-664af456a922", "name": "network-vif-plugged", "status": "completed", "tag": "0abca0b1-ade4-4453-a1f8-bec5e7c24c69"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:54:44.456637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:54:44.456637 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:54:44.468510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-702c3453-512e-45da-ba69-63059fcaba1c req-ff149926-b665-4005-a22b-7ee4dfdd174b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:44.469014 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-702c3453-512e-45da-ba69-63059fcaba1c req-ff149926-b665-4005-a22b-7ee4dfdd174b service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:44.488991 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-702c3453-512e-45da-ba69-63059fcaba1c req-ff149926-b665-4005-a22b-7ee4dfdd174b service nova] Creating event network-vif-plugged:0abca0b1-ade4-4453-a1f8-bec5e7c24c69 for instance 831e6747-0fba-4087-a5c1-664af456a922 on hv-cinder-78638 Apr 21 14:54:44.495114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-702c3453-512e-45da-ba69-63059fcaba1c req-ff149926-b665-4005-a22b-7ee4dfdd174b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046591 Apr 21 14:54:44.495983 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 657/1245] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:54:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:54:44.671526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b33b7ccb-20de-43ef-be7c-348d4d0ee138 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:44.672095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b33b7ccb-20de-43ef-be7c-348d4d0ee138 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:44.681319 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b33b7ccb-20de-43ef-be7c-348d4d0ee138 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:44.681828 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b33b7ccb-20de-43ef-be7c-348d4d0ee138 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:44.682734 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b33b7ccb-20de-43ef-be7c-348d4d0ee138 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:44.683223 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b33b7ccb-20de-43ef-be7c-348d4d0ee138 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:45.063392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b33b7ccb-20de-43ef-be7c-348d4d0ee138 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:45.073545 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b33b7ccb-20de-43ef-be7c-348d4d0ee138 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1359 microversion: 2.1 time: 0.406666 Apr 21 14:54:45.074242 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 589/1246] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:44 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1359 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:46.093852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c40c9841-e342-41f1-a24c-7a235cde52ac tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:46.094773 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c40c9841-e342-41f1-a24c-7a235cde52ac tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:46.104528 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c40c9841-e342-41f1-a24c-7a235cde52ac tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:46.105383 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c40c9841-e342-41f1-a24c-7a235cde52ac tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:46.106792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c40c9841-e342-41f1-a24c-7a235cde52ac tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:46.107516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c40c9841-e342-41f1-a24c-7a235cde52ac tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:46.358806 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c40c9841-e342-41f1-a24c-7a235cde52ac tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:46.369321 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c40c9841-e342-41f1-a24c-7a235cde52ac tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1548 microversion: 2.1 time: 0.279822 Apr 21 14:54:46.370266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 658/1247] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:46 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1548 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:46.388669 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4865b2f8-51c4-4e5f-9e2f-56bf2165cf1f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:46.389435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4865b2f8-51c4-4e5f-9e2f-56bf2165cf1f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:46.398273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4865b2f8-51c4-4e5f-9e2f-56bf2165cf1f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:46.398765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4865b2f8-51c4-4e5f-9e2f-56bf2165cf1f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:46.399684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4865b2f8-51c4-4e5f-9e2f-56bf2165cf1f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:46.400149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4865b2f8-51c4-4e5f-9e2f-56bf2165cf1f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:46.639235 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4865b2f8-51c4-4e5f-9e2f-56bf2165cf1f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:46.654435 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4865b2f8-51c4-4e5f-9e2f-56bf2165cf1f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1548 microversion: 2.1 time: 0.269278 Apr 21 14:54:46.655832 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 590/1248] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:46 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1548 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:46.682965 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4337a38e-2866-4ec9-87a5-9a23a6da8311 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:46.686957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:54:46.686957 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:54:46.688158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4337a38e-2866-4ec9-87a5-9a23a6da8311 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:46.689001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4337a38e-2866-4ec9-87a5-9a23a6da8311 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Searching by: {'deleted': False, 'project_id': '0e1ab995c213484f9e8260545de2fad5'} {{(pid=100564) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 21 14:54:46.695440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4337a38e-2866-4ec9-87a5-9a23a6da8311 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:46.695950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4337a38e-2866-4ec9-87a5-9a23a6da8311 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:46.696879 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4337a38e-2866-4ec9-87a5-9a23a6da8311 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:46.698080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4337a38e-2866-4ec9-87a5-9a23a6da8311 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:46.800956 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.multi_cell_list [None req-4337a38e-2866-4ec9-87a5-9a23a6da8311 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=100564) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 21 14:54:46.902951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4337a38e-2866-4ec9-87a5-9a23a6da8311 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.224469 Apr 21 14:54:46.903622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 659/1249] 10.222.0.24 () {58 vars in 1115 bytes} [Wed Apr 21 14:54:46 2021] GET /compute/v2.1/servers => generated 343 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:54:46.917485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-001f2464-a911-44d7-810a-de96002cd217 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:46.918215 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-001f2464-a911-44d7-810a-de96002cd217 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:46.927457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-001f2464-a911-44d7-810a-de96002cd217 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:46.927966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-001f2464-a911-44d7-810a-de96002cd217 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:46.928800 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-001f2464-a911-44d7-810a-de96002cd217 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:46.929285 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-001f2464-a911-44d7-810a-de96002cd217 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:47.253210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-001f2464-a911-44d7-810a-de96002cd217 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:47.263392 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-001f2464-a911-44d7-810a-de96002cd217 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1548 microversion: 2.1 time: 0.350145 Apr 21 14:54:47.264052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 591/1250] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:46 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1548 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:54:49.141191 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ccfbf286-9086-4e5b-9e58-e85735d5270e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0607ff6-1f59-4bbc-af41-3a86eb2797c4"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:54:49.142404 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ccfbf286-9086-4e5b-9e58-e85735d5270e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:49.150820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccfbf286-9086-4e5b-9e58-e85735d5270e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:49.151323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccfbf286-9086-4e5b-9e58-e85735d5270e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:49.152164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccfbf286-9086-4e5b-9e58-e85735d5270e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:49.152648 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccfbf286-9086-4e5b-9e58-e85735d5270e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:49.557127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ccfbf286-9086-4e5b-9e58-e85735d5270e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "POST /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420105 Apr 21 14:54:49.557794 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 660/1251] 10.222.0.24 () {60 vars in 1313 bytes} [Wed Apr 21 14:54:49 2021] POST /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:54:57.681974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2cbfdadc-697e-4c34-b8f2-aa5dad517882 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:54:57.682698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2cbfdadc-697e-4c34-b8f2-aa5dad517882 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:54:57.691180 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cbfdadc-697e-4c34-b8f2-aa5dad517882 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:57.691684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cbfdadc-697e-4c34-b8f2-aa5dad517882 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:57.692538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cbfdadc-697e-4c34-b8f2-aa5dad517882 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:54:57.693034 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cbfdadc-697e-4c34-b8f2-aa5dad517882 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:54:57.914526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2cbfdadc-697e-4c34-b8f2-aa5dad517882 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:54:57.925576 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2cbfdadc-697e-4c34-b8f2-aa5dad517882 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1594 microversion: 2.1 time: 0.247729 Apr 21 14:54:57.926246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 592/1252] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:54:57 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1594 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:00.748978 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-d029bf32-0ef8-446a-9024-5e82bfc19f5b req-15303ea0-3b68-4ac8-8b8c-62deda7f5b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831e6747-0fba-4087-a5c1-664af456a922", "tag": "0abca0b1-ade4-4453-a1f8-bec5e7c24c69"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:55:00.750719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:55:00.750719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:55:00.760840 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d029bf32-0ef8-446a-9024-5e82bfc19f5b req-15303ea0-3b68-4ac8-8b8c-62deda7f5b16 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:00.761341 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d029bf32-0ef8-446a-9024-5e82bfc19f5b req-15303ea0-3b68-4ac8-8b8c-62deda7f5b16 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:00.783814 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-d029bf32-0ef8-446a-9024-5e82bfc19f5b req-15303ea0-3b68-4ac8-8b8c-62deda7f5b16 service nova] Creating event network-changed:0abca0b1-ade4-4453-a1f8-bec5e7c24c69 for instance 831e6747-0fba-4087-a5c1-664af456a922 on hv-cinder-78638 Apr 21 14:55:00.789791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-d029bf32-0ef8-446a-9024-5e82bfc19f5b req-15303ea0-3b68-4ac8-8b8c-62deda7f5b16 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045405 Apr 21 14:55:00.790514 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 661/1253] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:55:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:55:02.437174 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b0cc2fad-9714-4b20-a94a-137704eab92a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1235362955"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:55:02.437765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b0cc2fad-9714-4b20-a94a-137704eab92a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:02.445999 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0cc2fad-9714-4b20-a94a-137704eab92a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:02.446552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0cc2fad-9714-4b20-a94a-137704eab92a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:02.447351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0cc2fad-9714-4b20-a94a-137704eab92a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:02.447836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0cc2fad-9714-4b20-a94a-137704eab92a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:02.682052 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.network.security_group_api [None req-b0cc2fad-9714-4b20-a94a-137704eab92a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Adding security group d1191425-3ddf-4838-a697-89a5351665c0 to port 0abca0b1-ade4-4453-a1f8-bec5e7c24c69 Apr 21 14:55:03.237799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b0cc2fad-9714-4b20-a94a-137704eab92a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "POST /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/action" status: 202 len: 0 microversion: 2.1 time: 0.800991 Apr 21 14:55:03.237799 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 593/1254] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:55:02 2021] POST /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:55:03.254356 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6cd016f8-ccc7-4f58-a55e-d762fa5dde40 req-cd8a5ae9-2a7c-40d9-a124-c65238d121e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831e6747-0fba-4087-a5c1-664af456a922", "tag": "0abca0b1-ade4-4453-a1f8-bec5e7c24c69"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:55:03.256518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:55:03.256518 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:55:03.257862 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4a8aa29b-5514-4df5-bb5b-6a2897089edc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:03.259487 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4a8aa29b-5514-4df5-bb5b-6a2897089edc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:03.267232 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6cd016f8-ccc7-4f58-a55e-d762fa5dde40 req-cd8a5ae9-2a7c-40d9-a124-c65238d121e1 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:03.268044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6cd016f8-ccc7-4f58-a55e-d762fa5dde40 req-cd8a5ae9-2a7c-40d9-a124-c65238d121e1 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:03.270719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a8aa29b-5514-4df5-bb5b-6a2897089edc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:03.271323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a8aa29b-5514-4df5-bb5b-6a2897089edc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:03.272261 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a8aa29b-5514-4df5-bb5b-6a2897089edc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:03.272855 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a8aa29b-5514-4df5-bb5b-6a2897089edc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:03.294892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6cd016f8-ccc7-4f58-a55e-d762fa5dde40 req-cd8a5ae9-2a7c-40d9-a124-c65238d121e1 service nova] Creating event network-changed:0abca0b1-ade4-4453-a1f8-bec5e7c24c69 for instance 831e6747-0fba-4087-a5c1-664af456a922 on hv-cinder-78638 Apr 21 14:55:03.301393 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6cd016f8-ccc7-4f58-a55e-d762fa5dde40 req-cd8a5ae9-2a7c-40d9-a124-c65238d121e1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054901 Apr 21 14:55:03.302333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 594/1255] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:55:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:55:03.525195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4a8aa29b-5514-4df5-bb5b-6a2897089edc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:03.535925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4a8aa29b-5514-4df5-bb5b-6a2897089edc tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1760 microversion: 2.1 time: 0.292277 Apr 21 14:55:03.536926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 662/1256] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:03 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1760 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:15.058765 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:55:15.059277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:55:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:55:20.309665 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:55:20.310290 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:55:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:55:24.223969 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1561911488", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1319973046", "security_groups": [{"name": "tempest-secgroup-smoke-222957663"}], "block_device_mapping_v2": [{"uuid": "96f11c80-c67f-4ad8-a61e-354bcc171d96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bf02896-5a06-4820-afef-e1d155642dab"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:55:24.415490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] validate_networks() for [('3bf02896-5a06-4820-afef-e1d155642dab', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 21 14:55:25.016205 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:55:25.016684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 21 14:55:25.017228 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:55:25.017689 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 21 14:55:25.018426 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 21 14:55:25.028483 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:25.029012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:25.029885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:25.030418 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:25.049871 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for project 47f31a5650834e49b288140b0ca768c2. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 21 14:55:25.054380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Getting quotas for user c134d419e09b4f7da63a8401c01bf6b3 and project 47f31a5650834e49b288140b0ca768c2. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 21 14:55:25.164538 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 21 14:55:25.168643 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96f11c80-c67f-4ad8-a61e-354bcc171d96',volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 21 14:55:25.366915 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-74496c70-5f4a-4059-b4d8-41573070ca86 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.150738 Apr 21 14:55:25.367611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 595/1257] 10.222.0.24 () {60 vars in 1137 bytes} [Wed Apr 21 14:55:24 2021] POST /compute/v2.1/servers => generated 405 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 21 14:55:25.379148 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-60c9bea4-c47a-4c14-a20f-8a2cdbce4003 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:25.379745 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-60c9bea4-c47a-4c14-a20f-8a2cdbce4003 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:25.459896 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-60c9bea4-c47a-4c14-a20f-8a2cdbce4003 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:25.468864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-60c9bea4-c47a-4c14-a20f-8a2cdbce4003 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1095 microversion: 2.1 time: 0.094260 Apr 21 14:55:25.469612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 663/1258] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:25 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1095 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:26.487165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ffa8e80-ef5c-4da6-a134-08bc453a2263 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:26.488639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2ffa8e80-ef5c-4da6-a134-08bc453a2263 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:26.498099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ffa8e80-ef5c-4da6-a134-08bc453a2263 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:26.498718 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ffa8e80-ef5c-4da6-a134-08bc453a2263 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:26.499656 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ffa8e80-ef5c-4da6-a134-08bc453a2263 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:26.500384 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ffa8e80-ef5c-4da6-a134-08bc453a2263 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:26.886836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ffa8e80-ef5c-4da6-a134-08bc453a2263 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:26.896183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ffa8e80-ef5c-4da6-a134-08bc453a2263 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1201 microversion: 2.1 time: 0.413180 Apr 21 14:55:26.896930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 596/1259] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:26 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1201 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:27.915064 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a4c6a29d-81f9-4191-9efa-6507da3c1063 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:27.915908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a4c6a29d-81f9-4191-9efa-6507da3c1063 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:27.925246 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4c6a29d-81f9-4191-9efa-6507da3c1063 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:27.925769 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4c6a29d-81f9-4191-9efa-6507da3c1063 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:27.926996 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4c6a29d-81f9-4191-9efa-6507da3c1063 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:27.927495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a4c6a29d-81f9-4191-9efa-6507da3c1063 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:28.162687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a4c6a29d-81f9-4191-9efa-6507da3c1063 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:28.171943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a4c6a29d-81f9-4191-9efa-6507da3c1063 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.261102 Apr 21 14:55:28.172564 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 664/1260] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:27 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:28.899283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-54a49092-02d1-4884-8488-25784da717cb req-0887a575-c000-404f-be16-05998fdc9756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce11bbf5-36db-4dfb-9099-f5e0706c001f", "tag": "1baac0ec-da08-435d-b211-9e2794271ab1"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:55:28.901188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:55:28.901188 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:55:28.910529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-54a49092-02d1-4884-8488-25784da717cb req-0887a575-c000-404f-be16-05998fdc9756 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:28.911023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-54a49092-02d1-4884-8488-25784da717cb req-0887a575-c000-404f-be16-05998fdc9756 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:28.931839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-54a49092-02d1-4884-8488-25784da717cb req-0887a575-c000-404f-be16-05998fdc9756 service nova] Creating event network-changed:1baac0ec-da08-435d-b211-9e2794271ab1 for instance ce11bbf5-36db-4dfb-9099-f5e0706c001f on hv-cinder-78638 Apr 21 14:55:28.937913 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-54a49092-02d1-4884-8488-25784da717cb req-0887a575-c000-404f-be16-05998fdc9756 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113299 Apr 21 14:55:28.939056 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 597/1261] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:55:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:55:29.190950 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-36ff9790-ed6b-4cc7-847c-26cce0af6b53 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:29.191671 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-36ff9790-ed6b-4cc7-847c-26cce0af6b53 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:29.200152 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ff9790-ed6b-4cc7-847c-26cce0af6b53 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:29.200658 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ff9790-ed6b-4cc7-847c-26cce0af6b53 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:29.201504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ff9790-ed6b-4cc7-847c-26cce0af6b53 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:29.202020 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ff9790-ed6b-4cc7-847c-26cce0af6b53 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:29.430322 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-36ff9790-ed6b-4cc7-847c-26cce0af6b53 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:29.441273 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-36ff9790-ed6b-4cc7-847c-26cce0af6b53 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.254660 Apr 21 14:55:29.441848 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 665/1262] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:29 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:30.460200 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e458d72-8453-4abf-aa26-4f386742010c tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:30.460925 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e458d72-8453-4abf-aa26-4f386742010c tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:30.469667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e458d72-8453-4abf-aa26-4f386742010c tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:30.470194 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e458d72-8453-4abf-aa26-4f386742010c tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:30.471026 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e458d72-8453-4abf-aa26-4f386742010c tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:30.471515 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e458d72-8453-4abf-aa26-4f386742010c tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:30.720325 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8e458d72-8453-4abf-aa26-4f386742010c tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:30.732820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e458d72-8453-4abf-aa26-4f386742010c tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.277200 Apr 21 14:55:30.733490 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 598/1263] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:30 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:31.752457 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7a94b429-53b4-486e-9c35-fc4f668d1099 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:31.753098 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7a94b429-53b4-486e-9c35-fc4f668d1099 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:31.761764 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a94b429-53b4-486e-9c35-fc4f668d1099 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:31.762330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a94b429-53b4-486e-9c35-fc4f668d1099 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:31.763211 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a94b429-53b4-486e-9c35-fc4f668d1099 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:31.763691 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a94b429-53b4-486e-9c35-fc4f668d1099 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:31.998635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7a94b429-53b4-486e-9c35-fc4f668d1099 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:32.007976 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7a94b429-53b4-486e-9c35-fc4f668d1099 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.260575 Apr 21 14:55:32.008617 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 666/1264] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:31 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:33.029344 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8fa41924-a167-4c58-b66c-00c24d23ec20 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:33.030295 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8fa41924-a167-4c58-b66c-00c24d23ec20 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:33.042517 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fa41924-a167-4c58-b66c-00c24d23ec20 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:33.043145 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fa41924-a167-4c58-b66c-00c24d23ec20 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:33.043869 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fa41924-a167-4c58-b66c-00c24d23ec20 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:33.044386 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fa41924-a167-4c58-b66c-00c24d23ec20 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:33.282592 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8fa41924-a167-4c58-b66c-00c24d23ec20 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:33.296437 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8fa41924-a167-4c58-b66c-00c24d23ec20 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.274054 Apr 21 14:55:33.297311 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 599/1265] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:33 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:34.322647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9480c17c-3c7e-4d63-b7ac-26a7fce6e7a5 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:34.323495 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9480c17c-3c7e-4d63-b7ac-26a7fce6e7a5 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:34.334567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9480c17c-3c7e-4d63-b7ac-26a7fce6e7a5 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:34.335082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9480c17c-3c7e-4d63-b7ac-26a7fce6e7a5 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:34.335959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9480c17c-3c7e-4d63-b7ac-26a7fce6e7a5 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:34.336456 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9480c17c-3c7e-4d63-b7ac-26a7fce6e7a5 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:34.560156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9480c17c-3c7e-4d63-b7ac-26a7fce6e7a5 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:34.570703 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9480c17c-3c7e-4d63-b7ac-26a7fce6e7a5 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.255240 Apr 21 14:55:34.571305 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 667/1266] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:34 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:35.589338 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b06ff2a5-3c45-417c-b931-639ced608d31 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:35.589974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b06ff2a5-3c45-417c-b931-639ced608d31 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:35.598734 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b06ff2a5-3c45-417c-b931-639ced608d31 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:35.599230 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b06ff2a5-3c45-417c-b931-639ced608d31 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:35.600095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b06ff2a5-3c45-417c-b931-639ced608d31 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:35.600589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b06ff2a5-3c45-417c-b931-639ced608d31 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:35.823488 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b06ff2a5-3c45-417c-b931-639ced608d31 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:35.833140 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b06ff2a5-3c45-417c-b931-639ced608d31 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.247996 Apr 21 14:55:35.833775 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 600/1267] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:35 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:36.851962 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-77051992-fd72-4160-abcc-7cf047a2dd02 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:36.852585 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-77051992-fd72-4160-abcc-7cf047a2dd02 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:36.860990 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77051992-fd72-4160-abcc-7cf047a2dd02 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:36.861492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77051992-fd72-4160-abcc-7cf047a2dd02 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:36.862358 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77051992-fd72-4160-abcc-7cf047a2dd02 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:36.862823 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77051992-fd72-4160-abcc-7cf047a2dd02 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:37.084209 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-77051992-fd72-4160-abcc-7cf047a2dd02 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:37.095060 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-77051992-fd72-4160-abcc-7cf047a2dd02 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.247105 Apr 21 14:55:37.095724 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 668/1268] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:36 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:38.116647 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-437025f8-4dc8-4492-a598-87414ffbf877 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:38.117293 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-437025f8-4dc8-4492-a598-87414ffbf877 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:38.126120 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-437025f8-4dc8-4492-a598-87414ffbf877 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:38.126634 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-437025f8-4dc8-4492-a598-87414ffbf877 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:38.127458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-437025f8-4dc8-4492-a598-87414ffbf877 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:38.127948 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-437025f8-4dc8-4492-a598-87414ffbf877 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:38.351401 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-437025f8-4dc8-4492-a598-87414ffbf877 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:38.360981 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-437025f8-4dc8-4492-a598-87414ffbf877 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.248983 Apr 21 14:55:38.361698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 601/1269] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:38 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:39.379897 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f870adbc-8a25-4659-a049-8a62052d1db3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:39.380512 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f870adbc-8a25-4659-a049-8a62052d1db3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:39.388864 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f870adbc-8a25-4659-a049-8a62052d1db3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:39.389369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f870adbc-8a25-4659-a049-8a62052d1db3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:39.390287 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f870adbc-8a25-4659-a049-8a62052d1db3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:39.390777 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f870adbc-8a25-4659-a049-8a62052d1db3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:39.611959 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f870adbc-8a25-4659-a049-8a62052d1db3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:39.621506 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f870adbc-8a25-4659-a049-8a62052d1db3 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.246014 Apr 21 14:55:39.622141 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 669/1270] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:39 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:40.640934 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e474869-c519-4ec4-872d-4db73769740e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:40.641543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7e474869-c519-4ec4-872d-4db73769740e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:40.649895 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e474869-c519-4ec4-872d-4db73769740e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:40.650452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e474869-c519-4ec4-872d-4db73769740e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:40.651315 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e474869-c519-4ec4-872d-4db73769740e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:40.651814 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e474869-c519-4ec4-872d-4db73769740e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:40.765750 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-af2367ef-479f-4b99-869e-a6b93b4c0faa req-50c44719-d66c-4f3b-848a-9f297a8e4bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce11bbf5-36db-4dfb-9099-f5e0706c001f", "name": "network-vif-plugged", "status": "completed", "tag": "1baac0ec-da08-435d-b211-9e2794271ab1"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:55:40.767771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:55:40.767771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:55:40.778252 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-af2367ef-479f-4b99-869e-a6b93b4c0faa req-50c44719-d66c-4f3b-848a-9f297a8e4bdc service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:40.778755 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-af2367ef-479f-4b99-869e-a6b93b4c0faa req-50c44719-d66c-4f3b-848a-9f297a8e4bdc service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:40.797332 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-af2367ef-479f-4b99-869e-a6b93b4c0faa req-50c44719-d66c-4f3b-848a-9f297a8e4bdc service nova] Creating event network-vif-plugged:1baac0ec-da08-435d-b211-9e2794271ab1 for instance ce11bbf5-36db-4dfb-9099-f5e0706c001f on hv-cinder-78638 Apr 21 14:55:40.803462 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-af2367ef-479f-4b99-869e-a6b93b4c0faa req-50c44719-d66c-4f3b-848a-9f297a8e4bdc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041849 Apr 21 14:55:40.804537 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 670/1271] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:55:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:55:40.882723 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7e474869-c519-4ec4-872d-4db73769740e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:40.892019 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7e474869-c519-4ec4-872d-4db73769740e tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.255295 Apr 21 14:55:40.892663 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 602/1272] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:40 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:41.910504 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e68f471e-a0c5-4a6b-955c-17d9165fb177 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:41.911445 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e68f471e-a0c5-4a6b-955c-17d9165fb177 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:41.920527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e68f471e-a0c5-4a6b-955c-17d9165fb177 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:41.921043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e68f471e-a0c5-4a6b-955c-17d9165fb177 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:41.921946 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e68f471e-a0c5-4a6b-955c-17d9165fb177 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:41.922452 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e68f471e-a0c5-4a6b-955c-17d9165fb177 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:42.153516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e68f471e-a0c5-4a6b-955c-17d9165fb177 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:42.163954 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e68f471e-a0c5-4a6b-955c-17d9165fb177 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1266 microversion: 2.1 time: 0.258104 Apr 21 14:55:42.164604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 671/1273] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:41 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:43.183534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b303db79-aa46-4f68-a5d5-03ada665db07 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:43.184175 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b303db79-aa46-4f68-a5d5-03ada665db07 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:43.193299 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b303db79-aa46-4f68-a5d5-03ada665db07 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:43.193841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b303db79-aa46-4f68-a5d5-03ada665db07 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:43.194748 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b303db79-aa46-4f68-a5d5-03ada665db07 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:43.195255 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b303db79-aa46-4f68-a5d5-03ada665db07 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:43.417421 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b303db79-aa46-4f68-a5d5-03ada665db07 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:43.427491 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b303db79-aa46-4f68-a5d5-03ada665db07 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1453 microversion: 2.1 time: 0.248327 Apr 21 14:55:43.428096 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 603/1274] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:43 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1453 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:43.445083 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fbed4741-94d4-46d2-8ffd-6a92d72a2d65 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:55:43.445747 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fbed4741-94d4-46d2-8ffd-6a92d72a2d65 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:55:43.454687 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbed4741-94d4-46d2-8ffd-6a92d72a2d65 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:43.455193 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbed4741-94d4-46d2-8ffd-6a92d72a2d65 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:43.456041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbed4741-94d4-46d2-8ffd-6a92d72a2d65 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:43.456533 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbed4741-94d4-46d2-8ffd-6a92d72a2d65 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:43.695885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fbed4741-94d4-46d2-8ffd-6a92d72a2d65 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:55:43.710992 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fbed4741-94d4-46d2-8ffd-6a92d72a2d65 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1453 microversion: 2.1 time: 0.269756 Apr 21 14:55:43.711967 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 672/1275] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:55:43 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1453 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:55:46.675360 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-2adff363-8d17-4b34-8cd7-2a23573e6f1f req-05184c92-ef46-4a74-a244-125c0dbcd270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce11bbf5-36db-4dfb-9099-f5e0706c001f", "tag": "1baac0ec-da08-435d-b211-9e2794271ab1"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:55:46.678670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:55:46.678670 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:55:46.696553 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2adff363-8d17-4b34-8cd7-2a23573e6f1f req-05184c92-ef46-4a74-a244-125c0dbcd270 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:55:46.697940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2adff363-8d17-4b34-8cd7-2a23573e6f1f req-05184c92-ef46-4a74-a244-125c0dbcd270 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:55:46.736580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-2adff363-8d17-4b34-8cd7-2a23573e6f1f req-05184c92-ef46-4a74-a244-125c0dbcd270 service nova] Creating event network-changed:1baac0ec-da08-435d-b211-9e2794271ab1 for instance ce11bbf5-36db-4dfb-9099-f5e0706c001f on hv-cinder-78638 Apr 21 14:55:46.746839 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-2adff363-8d17-4b34-8cd7-2a23573e6f1f req-05184c92-ef46-4a74-a244-125c0dbcd270 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078255 Apr 21 14:55:46.748111 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 604/1276] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:55:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:56:15.689183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fa7f7aea-a677-4ac8-9870-b81925b79a6a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:56:15.690303 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fa7f7aea-a677-4ac8-9870-b81925b79a6a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:15.700214 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa7f7aea-a677-4ac8-9870-b81925b79a6a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:15.700909 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa7f7aea-a677-4ac8-9870-b81925b79a6a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:15.701556 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa7f7aea-a677-4ac8-9870-b81925b79a6a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:15.702063 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa7f7aea-a677-4ac8-9870-b81925b79a6a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:15.854370 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fa7f7aea-a677-4ac8-9870-b81925b79a6a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "POST /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/action" status: 202 len: 0 microversion: 2.1 time: 0.169107 Apr 21 14:56:15.855132 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 673/1277] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:56:15 2021] POST /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:56:15.865165 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a013ca1-8d7e-4be7-80ff-8c159395d926 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:15.866110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a013ca1-8d7e-4be7-80ff-8c159395d926 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:15.874854 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a013ca1-8d7e-4be7-80ff-8c159395d926 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:15.875372 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a013ca1-8d7e-4be7-80ff-8c159395d926 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:15.876262 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a013ca1-8d7e-4be7-80ff-8c159395d926 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:15.876759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a013ca1-8d7e-4be7-80ff-8c159395d926 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:16.260178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3a013ca1-8d7e-4be7-80ff-8c159395d926 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:16.270447 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a013ca1-8d7e-4be7-80ff-8c159395d926 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1752 microversion: 2.1 time: 0.410067 Apr 21 14:56:16.271094 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 605/1278] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:15 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1752 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:56:17.290395 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f8ddfacd-7437-446c-99ca-43109aa3e8e6 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:17.291168 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f8ddfacd-7437-446c-99ca-43109aa3e8e6 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:17.300468 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8ddfacd-7437-446c-99ca-43109aa3e8e6 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:17.300980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8ddfacd-7437-446c-99ca-43109aa3e8e6 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:17.301803 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8ddfacd-7437-446c-99ca-43109aa3e8e6 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:17.302330 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8ddfacd-7437-446c-99ca-43109aa3e8e6 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:17.538272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f8ddfacd-7437-446c-99ca-43109aa3e8e6 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:17.548635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f8ddfacd-7437-446c-99ca-43109aa3e8e6 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1757 microversion: 2.1 time: 0.262905 Apr 21 14:56:17.549531 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 674/1279] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:17 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1757 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:56:18.572804 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-31353c9e-0bac-4393-8b62-2199cbb89658 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:18.573500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-31353c9e-0bac-4393-8b62-2199cbb89658 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:18.582221 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-31353c9e-0bac-4393-8b62-2199cbb89658 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:18.582737 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-31353c9e-0bac-4393-8b62-2199cbb89658 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:18.583589 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-31353c9e-0bac-4393-8b62-2199cbb89658 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:18.584082 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-31353c9e-0bac-4393-8b62-2199cbb89658 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:18.825858 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-31353c9e-0bac-4393-8b62-2199cbb89658 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:18.836192 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-31353c9e-0bac-4393-8b62-2199cbb89658 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1757 microversion: 2.1 time: 0.267508 Apr 21 14:56:18.836837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 606/1280] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:18 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1757 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:56:19.856396 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b930946d-ab6e-4706-91ef-e74692f24f51 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:19.857016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b930946d-ab6e-4706-91ef-e74692f24f51 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:19.865698 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b930946d-ab6e-4706-91ef-e74692f24f51 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:19.866259 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b930946d-ab6e-4706-91ef-e74692f24f51 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:19.867106 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b930946d-ab6e-4706-91ef-e74692f24f51 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:19.867611 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b930946d-ab6e-4706-91ef-e74692f24f51 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:20.092213 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b930946d-ab6e-4706-91ef-e74692f24f51 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:20.103340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b930946d-ab6e-4706-91ef-e74692f24f51 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1757 microversion: 2.1 time: 0.251717 Apr 21 14:56:20.103979 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 675/1281] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:19 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1757 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:56:21.124527 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c98e2740-fdcd-47ec-9f30-b0cae252cf96 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:21.125208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c98e2740-fdcd-47ec-9f30-b0cae252cf96 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:21.133565 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c98e2740-fdcd-47ec-9f30-b0cae252cf96 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:21.134500 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c98e2740-fdcd-47ec-9f30-b0cae252cf96 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:21.134930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c98e2740-fdcd-47ec-9f30-b0cae252cf96 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:21.135425 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c98e2740-fdcd-47ec-9f30-b0cae252cf96 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:21.371943 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c98e2740-fdcd-47ec-9f30-b0cae252cf96 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:21.383781 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c98e2740-fdcd-47ec-9f30-b0cae252cf96 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1757 microversion: 2.1 time: 0.263493 Apr 21 14:56:21.384604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 607/1282] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:21 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1757 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:56:22.404511 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3ff3be58-49ff-49b5-b952-82f46095a1b8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:22.405142 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3ff3be58-49ff-49b5-b952-82f46095a1b8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:22.413831 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff3be58-49ff-49b5-b952-82f46095a1b8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:22.414387 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff3be58-49ff-49b5-b952-82f46095a1b8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:22.415231 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff3be58-49ff-49b5-b952-82f46095a1b8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:22.415719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff3be58-49ff-49b5-b952-82f46095a1b8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:22.645930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3ff3be58-49ff-49b5-b952-82f46095a1b8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:22.656436 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3ff3be58-49ff-49b5-b952-82f46095a1b8 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1757 microversion: 2.1 time: 0.255929 Apr 21 14:56:22.656994 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 676/1283] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:22 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:56:23.676218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9146162d-7af5-46d3-b1fb-866eee23681d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:23.676894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9146162d-7af5-46d3-b1fb-866eee23681d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:23.685451 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9146162d-7af5-46d3-b1fb-866eee23681d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:23.685951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9146162d-7af5-46d3-b1fb-866eee23681d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:23.686850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9146162d-7af5-46d3-b1fb-866eee23681d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:23.687339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9146162d-7af5-46d3-b1fb-866eee23681d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:23.925860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9146162d-7af5-46d3-b1fb-866eee23681d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:23.936011 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9146162d-7af5-46d3-b1fb-866eee23681d tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1757 microversion: 2.1 time: 0.264334 Apr 21 14:56:23.936567 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 608/1284] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:23 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1757 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:56:24.955272 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a940f986-6809-444c-861f-0601c56040c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:24.955894 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a940f986-6809-444c-861f-0601c56040c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:24.964636 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a940f986-6809-444c-861f-0601c56040c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:24.965149 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a940f986-6809-444c-861f-0601c56040c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:24.966044 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a940f986-6809-444c-861f-0601c56040c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:24.966606 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a940f986-6809-444c-861f-0601c56040c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:25.196955 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a940f986-6809-444c-861f-0601c56040c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:25.208933 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a940f986-6809-444c-861f-0601c56040c7 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1757 microversion: 2.1 time: 0.257875 Apr 21 14:56:25.209516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 677/1285] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:24 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1757 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:56:26.227300 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-448a74ae-7660-4135-9850-67a066f19a2f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:26.227964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-448a74ae-7660-4135-9850-67a066f19a2f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:26.236414 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-448a74ae-7660-4135-9850-67a066f19a2f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:26.236922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-448a74ae-7660-4135-9850-67a066f19a2f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:26.237757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-448a74ae-7660-4135-9850-67a066f19a2f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:26.238269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-448a74ae-7660-4135-9850-67a066f19a2f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:26.462037 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-448a74ae-7660-4135-9850-67a066f19a2f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:26.472095 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-448a74ae-7660-4135-9850-67a066f19a2f tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1757 microversion: 2.1 time: 0.248781 Apr 21 14:56:26.472719 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 609/1286] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:26 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:56:27.491068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cea79e13-202a-4e26-a28d-d0c7b796457e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:27.491791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cea79e13-202a-4e26-a28d-d0c7b796457e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:27.500249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cea79e13-202a-4e26-a28d-d0c7b796457e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:27.500762 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cea79e13-202a-4e26-a28d-d0c7b796457e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:27.501599 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cea79e13-202a-4e26-a28d-d0c7b796457e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:27.502126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cea79e13-202a-4e26-a28d-d0c7b796457e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:27.726944 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cea79e13-202a-4e26-a28d-d0c7b796457e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:27.737166 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cea79e13-202a-4e26-a28d-d0c7b796457e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1757 microversion: 2.1 time: 0.250169 Apr 21 14:56:27.737806 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 678/1287] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:27 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1757 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:56:28.756159 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0ab54858-8ee1-4e78-88f5-ef1e95a7d8b4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:56:28.756785 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0ab54858-8ee1-4e78-88f5-ef1e95a7d8b4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:56:28.765679 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ab54858-8ee1-4e78-88f5-ef1e95a7d8b4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:28.766249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ab54858-8ee1-4e78-88f5-ef1e95a7d8b4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:28.767110 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ab54858-8ee1-4e78-88f5-ef1e95a7d8b4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:56:28.767628 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ab54858-8ee1-4e78-88f5-ef1e95a7d8b4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:56:28.991018 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0ab54858-8ee1-4e78-88f5-ef1e95a7d8b4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:56:29.001041 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0ab54858-8ee1-4e78-88f5-ef1e95a7d8b4 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1760 microversion: 2.1 time: 0.249085 Apr 21 14:56:29.001688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 610/1288] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:56:28 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1760 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:57:00.633257 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:57:00.633930 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:57:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:57:20.842244 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:57:20.842900 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:57:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 14:57:26.797202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7b0f8592-9d24-489d-abda-8812174e3079 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1235362955"}} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:57:26.797793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7b0f8592-9d24-489d-abda-8812174e3079 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:26.806928 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b0f8592-9d24-489d-abda-8812174e3079 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:26.807516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b0f8592-9d24-489d-abda-8812174e3079 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:26.808852 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b0f8592-9d24-489d-abda-8812174e3079 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:26.809402 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b0f8592-9d24-489d-abda-8812174e3079 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:27.025365 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.network.security_group_api [None req-7b0f8592-9d24-489d-abda-8812174e3079 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Removing security group d1191425-3ddf-4838-a697-89a5351665c0 from port 0abca0b1-ade4-4453-a1f8-bec5e7c24c69 Apr 21 14:57:27.579880 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7b0f8592-9d24-489d-abda-8812174e3079 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "POST /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/action" status: 202 len: 0 microversion: 2.1 time: 0.787143 Apr 21 14:57:27.580821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 679/1289] 10.222.0.24 () {60 vars in 1268 bytes} [Wed Apr 21 14:57:26 2021] POST /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:57:27.593623 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-39ab084a-e17f-4764-9602-04dee0167e4e req-31ea31f8-cfe5-42ab-8dac-e2772e9c8f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831e6747-0fba-4087-a5c1-664af456a922", "tag": "0abca0b1-ade4-4453-a1f8-bec5e7c24c69"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:57:27.596124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:57:27.596124 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:57:27.624102 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cfdb13b7-7bc2-4d12-9faf-2455bd328414] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 21 14:57:27.626574 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-39ab084a-e17f-4764-9602-04dee0167e4e req-31ea31f8-cfe5-42ab-8dac-e2772e9c8f7a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:27.627374 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-39ab084a-e17f-4764-9602-04dee0167e4e req-31ea31f8-cfe5-42ab-8dac-e2772e9c8f7a service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:27.649616 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-39ab084a-e17f-4764-9602-04dee0167e4e req-31ea31f8-cfe5-42ab-8dac-e2772e9c8f7a service nova] Creating event network-changed:0abca0b1-ade4-4453-a1f8-bec5e7c24c69 for instance 831e6747-0fba-4087-a5c1-664af456a922 on hv-cinder-78638 Apr 21 14:57:27.656055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-39ab084a-e17f-4764-9602-04dee0167e4e req-31ea31f8-cfe5-42ab-8dac-e2772e9c8f7a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068111 Apr 21 14:57:27.657164 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 611/1290] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:57:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:57:29.901139 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2c50fafc-7862-4bde-8f41-3c696f6198de tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:29.901686 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2c50fafc-7862-4bde-8f41-3c696f6198de tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:29.910178 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c50fafc-7862-4bde-8f41-3c696f6198de tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:29.910759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c50fafc-7862-4bde-8f41-3c696f6198de tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:29.911609 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c50fafc-7862-4bde-8f41-3c696f6198de tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:29.912103 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c50fafc-7862-4bde-8f41-3c696f6198de tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:29.914951 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-17f48998-d7cc-4141-8da9-578a032871d3 req-0eff1586-50ef-4a51-bbbd-92376e19d19e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831e6747-0fba-4087-a5c1-664af456a922", "tag": "0abca0b1-ade4-4453-a1f8-bec5e7c24c69"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:57:29.916796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:57:29.916796 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:57:29.930390 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-17f48998-d7cc-4141-8da9-578a032871d3 req-0eff1586-50ef-4a51-bbbd-92376e19d19e service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:29.930889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-17f48998-d7cc-4141-8da9-578a032871d3 req-0eff1586-50ef-4a51-bbbd-92376e19d19e service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:29.951478 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-17f48998-d7cc-4141-8da9-578a032871d3 req-0eff1586-50ef-4a51-bbbd-92376e19d19e service nova] Creating event network-changed:0abca0b1-ade4-4453-a1f8-bec5e7c24c69 for instance 831e6747-0fba-4087-a5c1-664af456a922 on hv-cinder-78638 Apr 21 14:57:29.956837 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-17f48998-d7cc-4141-8da9-578a032871d3 req-0eff1586-50ef-4a51-bbbd-92376e19d19e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058250 Apr 21 14:57:29.957757 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 612/1291] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:57:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:57:30.098860 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-2c50fafc-7862-4bde-8f41-3c696f6198de tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lazy-loading 'services' on Instance uuid 831e6747-0fba-4087-a5c1-664af456a922 {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:57:30.247547 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2c50fafc-7862-4bde-8f41-3c696f6198de tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "DELETE /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments/c0607ff6-1f59-4bbc-af41-3a86eb2797c4" status: 202 len: 0 microversion: 2.1 time: 0.350331 Apr 21 14:57:30.251202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 680/1292] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:57:29 2021] DELETE /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments/c0607ff6-1f59-4bbc-af41-3a86eb2797c4 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 21 14:57:30.257968 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9b7aba1c-0a02-425a-8cc0-95011788909e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:30.259134 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9b7aba1c-0a02-425a-8cc0-95011788909e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:30.266635 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] [cfdb13b7-7bc2-4d12-9faf-2455bd328414] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 38056. Apr 21 14:57:30.268351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b7aba1c-0a02-425a-8cc0-95011788909e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:30.268851 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b7aba1c-0a02-425a-8cc0-95011788909e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:30.269741 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b7aba1c-0a02-425a-8cc0-95011788909e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:30.270264 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b7aba1c-0a02-425a-8cc0-95011788909e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:30.351361 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9b7aba1c-0a02-425a-8cc0-95011788909e tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097813 Apr 21 14:57:30.352136 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 613/1293] 10.222.0.24 () {58 vars in 1292 bytes} [Wed Apr 21 14:57:30 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:57:31.365759 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab9faf78-70db-4496-be55-1f7667bc8386 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:31.367746 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ab9faf78-70db-4496-be55-1f7667bc8386 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:31.376793 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab9faf78-70db-4496-be55-1f7667bc8386 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:31.377328 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab9faf78-70db-4496-be55-1f7667bc8386 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:31.378613 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab9faf78-70db-4496-be55-1f7667bc8386 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:31.379075 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab9faf78-70db-4496-be55-1f7667bc8386 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:31.452029 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ab9faf78-70db-4496-be55-1f7667bc8386 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090864 Apr 21 14:57:31.452525 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 681/1294] 10.222.0.24 () {58 vars in 1292 bytes} [Wed Apr 21 14:57:31 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:57:31.463976 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d3e7bb9f-65d0-48bd-8d18-0a31a6b810ff tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:31.464523 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d3e7bb9f-65d0-48bd-8d18-0a31a6b810ff tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:31.472850 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3e7bb9f-65d0-48bd-8d18-0a31a6b810ff tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:31.473366 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3e7bb9f-65d0-48bd-8d18-0a31a6b810ff tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:31.474277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3e7bb9f-65d0-48bd-8d18-0a31a6b810ff tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:31.474801 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3e7bb9f-65d0-48bd-8d18-0a31a6b810ff tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:31.642241 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-d3e7bb9f-65d0-48bd-8d18-0a31a6b810ff tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] HTTP exception thrown: Instance 831e6747-0fba-4087-a5c1-664af456a922 is not attached to volume c0607ff6-1f59-4bbc-af41-3a86eb2797c4 Apr 21 14:57:31.642913 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d3e7bb9f-65d0-48bd-8d18-0a31a6b810ff tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Returning 404 to user: Instance 831e6747-0fba-4087-a5c1-664af456a922 is not attached to volume c0607ff6-1f59-4bbc-af41-3a86eb2797c4 {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:57:31.643838 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d3e7bb9f-65d0-48bd-8d18-0a31a6b810ff tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "DELETE /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments/c0607ff6-1f59-4bbc-af41-3a86eb2797c4" status: 404 len: 154 microversion: 2.1 time: 0.184282 Apr 21 14:57:31.644465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 614/1295] 10.222.0.24 () {58 vars in 1406 bytes} [Wed Apr 21 14:57:31 2021] DELETE /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922/os-volume_attachments/c0607ff6-1f59-4bbc-af41-3a86eb2797c4 => generated 154 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:57:32.908534 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3b410c19-cd6d-4e4b-9464-08659beb92f1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:32.909119 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3b410c19-cd6d-4e4b-9464-08659beb92f1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:32.918465 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b410c19-cd6d-4e4b-9464-08659beb92f1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:32.918970 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b410c19-cd6d-4e4b-9464-08659beb92f1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:32.919798 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b410c19-cd6d-4e4b-9464-08659beb92f1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:32.920283 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b410c19-cd6d-4e4b-9464-08659beb92f1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:32.985927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3b410c19-cd6d-4e4b-9464-08659beb92f1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:57:33.110675 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3b410c19-cd6d-4e4b-9464-08659beb92f1 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "DELETE /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 204 len: 0 microversion: 2.1 time: 0.207567 Apr 21 14:57:33.111266 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 682/1296] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:57:32 2021] DELETE /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:57:33.120891 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f4315d42-ca56-430b-b41c-ccb55f6b1fd9 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:33.121577 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f4315d42-ca56-430b-b41c-ccb55f6b1fd9 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:33.130115 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4315d42-ca56-430b-b41c-ccb55f6b1fd9 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:33.130629 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4315d42-ca56-430b-b41c-ccb55f6b1fd9 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:33.131543 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4315d42-ca56-430b-b41c-ccb55f6b1fd9 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:33.132013 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4315d42-ca56-430b-b41c-ccb55f6b1fd9 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:33.380741 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f4315d42-ca56-430b-b41c-ccb55f6b1fd9 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:57:33.389918 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f4315d42-ca56-430b-b41c-ccb55f6b1fd9 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1554 microversion: 2.1 time: 0.273620 Apr 21 14:57:33.390581 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 615/1297] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:33 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1554 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:57:34.412481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7f8d79f9-a78b-451c-b322-7ea76b508702 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:34.413269 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7f8d79f9-a78b-451c-b322-7ea76b508702 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:34.421820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f8d79f9-a78b-451c-b322-7ea76b508702 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:34.422380 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f8d79f9-a78b-451c-b322-7ea76b508702 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:34.423225 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f8d79f9-a78b-451c-b322-7ea76b508702 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:34.424071 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f8d79f9-a78b-451c-b322-7ea76b508702 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:34.672291 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7f8d79f9-a78b-451c-b322-7ea76b508702 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:57:34.682333 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7f8d79f9-a78b-451c-b322-7ea76b508702 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1554 microversion: 2.1 time: 0.276179 Apr 21 14:57:34.682975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 683/1298] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:34 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:57:35.702874 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e408ed3b-a760-46a0-b09b-d4c6830d2e91 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:35.703557 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e408ed3b-a760-46a0-b09b-d4c6830d2e91 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:35.711820 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e408ed3b-a760-46a0-b09b-d4c6830d2e91 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:35.712323 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e408ed3b-a760-46a0-b09b-d4c6830d2e91 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:35.713161 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e408ed3b-a760-46a0-b09b-d4c6830d2e91 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:35.713649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e408ed3b-a760-46a0-b09b-d4c6830d2e91 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:35.943638 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e408ed3b-a760-46a0-b09b-d4c6830d2e91 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c2a31b513f4706bf4aab6c9cfc94cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1ab995c213484f9e8260545de2fad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:57:35.954688 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e408ed3b-a760-46a0-b09b-d4c6830d2e91 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 200 len: 1512 microversion: 2.1 time: 0.255932 Apr 21 14:57:35.955339 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 616/1299] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:35 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:57:36.014964 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-38332113-27da-4389-a29e-22a0396c044d req-86ec9321-1f49-4d58-afa4-c6298771f0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831e6747-0fba-4087-a5c1-664af456a922", "name": "network-vif-deleted", "tag": "0abca0b1-ade4-4453-a1f8-bec5e7c24c69"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:57:36.016940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:57:36.016940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:57:36.028729 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-38332113-27da-4389-a29e-22a0396c044d req-86ec9321-1f49-4d58-afa4-c6298771f0c7 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:36.029391 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-38332113-27da-4389-a29e-22a0396c044d req-86ec9321-1f49-4d58-afa4-c6298771f0c7 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:36.050156 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-38332113-27da-4389-a29e-22a0396c044d req-86ec9321-1f49-4d58-afa4-c6298771f0c7 service nova] Creating event network-vif-deleted:0abca0b1-ade4-4453-a1f8-bec5e7c24c69 for instance 831e6747-0fba-4087-a5c1-664af456a922 on hv-cinder-78638 Apr 21 14:57:36.055580 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-38332113-27da-4389-a29e-22a0396c044d req-86ec9321-1f49-4d58-afa4-c6298771f0c7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044980 Apr 21 14:57:36.056247 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 684/1300] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:57:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:57:36.973668 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1d9f50a2-1df5-4022-8929-37c74d2e0575 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:36.974301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1d9f50a2-1df5-4022-8929-37c74d2e0575 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] [instance: 831e6747-0fba-4087-a5c1-664af456a922] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:36.982940 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d9f50a2-1df5-4022-8929-37c74d2e0575 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:36.983475 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d9f50a2-1df5-4022-8929-37c74d2e0575 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:36.984337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d9f50a2-1df5-4022-8929-37c74d2e0575 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:36.984776 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d9f50a2-1df5-4022-8929-37c74d2e0575 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:37.043481 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-1d9f50a2-1df5-4022-8929-37c74d2e0575 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] HTTP exception thrown: Instance 831e6747-0fba-4087-a5c1-664af456a922 could not be found. Apr 21 14:57:37.044158 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1d9f50a2-1df5-4022-8929-37c74d2e0575 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Returning 404 to user: Instance 831e6747-0fba-4087-a5c1-664af456a922 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:57:37.045068 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1d9f50a2-1df5-4022-8929-37c74d2e0575 tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922" status: 404 len: 111 microversion: 2.1 time: 0.075795 Apr 21 14:57:37.045708 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 617/1301] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:36 2021] GET /compute/v2.1/servers/831e6747-0fba-4087-a5c1-664af456a922 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:57:37.056241 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dca5ea9f-03a9-4602-954b-cf50373b0e2a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] Calling method '.version_select at 0x7f19df311400>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:37.079249 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dca5ea9f-03a9-4602-954b-cf50373b0e2a tempest-TestMinimumBasicScenario-695230718 tempest-TestMinimumBasicScenario-695230718-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2090011206" status: 202 len: 0 microversion: 2.1 time: 0.027549 Apr 21 14:57:37.079892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 685/1302] 10.222.0.24 () {58 vars in 1262 bytes} [Wed Apr 21 14:57:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2090011206 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:57:38.144118 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-56a84824-67db-4692-9ec2-3d4abc87e7b6 req-3118e19b-e13f-403b-ac3d-e5563c8bc0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce11bbf5-36db-4dfb-9099-f5e0706c001f", "tag": "1baac0ec-da08-435d-b211-9e2794271ab1"}]} {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:57:38.145813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:57:38.145813 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:57:38.150016 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-728026b8-21f7-4fde-8f0c-acf71df40303 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:38.150570 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-728026b8-21f7-4fde-8f0c-acf71df40303 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:38.163695 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-728026b8-21f7-4fde-8f0c-acf71df40303 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:38.164195 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-728026b8-21f7-4fde-8f0c-acf71df40303 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:38.169346 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-56a84824-67db-4692-9ec2-3d4abc87e7b6 req-3118e19b-e13f-403b-ac3d-e5563c8bc0d6 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:38.169829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-56a84824-67db-4692-9ec2-3d4abc87e7b6 req-3118e19b-e13f-403b-ac3d-e5563c8bc0d6 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:38.174927 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-728026b8-21f7-4fde-8f0c-acf71df40303 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:38.175431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-728026b8-21f7-4fde-8f0c-acf71df40303 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:38.200345 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-56a84824-67db-4692-9ec2-3d4abc87e7b6 req-3118e19b-e13f-403b-ac3d-e5563c8bc0d6 service nova] Creating event network-changed:1baac0ec-da08-435d-b211-9e2794271ab1 for instance ce11bbf5-36db-4dfb-9099-f5e0706c001f on hv-cinder-78638 Apr 21 14:57:38.206277 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-56a84824-67db-4692-9ec2-3d4abc87e7b6 req-3118e19b-e13f-403b-ac3d-e5563c8bc0d6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066388 Apr 21 14:57:38.207791 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 686/1303] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:57:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:57:38.251952 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-728026b8-21f7-4fde-8f0c-acf71df40303 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:57:38.380722 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-728026b8-21f7-4fde-8f0c-acf71df40303 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "DELETE /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 204 len: 0 microversion: 2.1 time: 0.243009 Apr 21 14:57:38.385099 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 618/1304] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:57:38 2021] DELETE /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:57:38.392529 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ad9eefa5-543e-4af3-9a4a-4ce871886df8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:38.393297 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ad9eefa5-543e-4af3-9a4a-4ce871886df8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:38.404554 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad9eefa5-543e-4af3-9a4a-4ce871886df8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:38.405035 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad9eefa5-543e-4af3-9a4a-4ce871886df8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:38.406309 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad9eefa5-543e-4af3-9a4a-4ce871886df8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:38.406929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad9eefa5-543e-4af3-9a4a-4ce871886df8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:38.681633 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad9eefa5-543e-4af3-9a4a-4ce871886df8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:57:38.692431 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ad9eefa5-543e-4af3-9a4a-4ce871886df8 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1578 microversion: 2.1 time: 0.304374 Apr 21 14:57:38.693516 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 687/1305] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:38 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1578 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:57:39.712980 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5a79eeaf-93b3-42f9-86b6-2f3e7419a0df tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:39.713810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5a79eeaf-93b3-42f9-86b6-2f3e7419a0df tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:39.723641 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a79eeaf-93b3-42f9-86b6-2f3e7419a0df tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:39.724146 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a79eeaf-93b3-42f9-86b6-2f3e7419a0df tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:39.725000 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a79eeaf-93b3-42f9-86b6-2f3e7419a0df tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:39.725492 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a79eeaf-93b3-42f9-86b6-2f3e7419a0df tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:40.436204 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5a79eeaf-93b3-42f9-86b6-2f3e7419a0df tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:57:40.446012 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5a79eeaf-93b3-42f9-86b6-2f3e7419a0df tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1578 microversion: 2.1 time: 0.737757 Apr 21 14:57:40.446696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 619/1306] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:39 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1578 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:57:41.464696 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f6829e9f-5a19-4dc1-ad76-a9c139661932 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:41.465442 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f6829e9f-5a19-4dc1-ad76-a9c139661932 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:41.473905 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6829e9f-5a19-4dc1-ad76-a9c139661932 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:41.474484 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6829e9f-5a19-4dc1-ad76-a9c139661932 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:41.475337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6829e9f-5a19-4dc1-ad76-a9c139661932 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:41.475829 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6829e9f-5a19-4dc1-ad76-a9c139661932 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:41.695369 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f6829e9f-5a19-4dc1-ad76-a9c139661932 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:57:41.704989 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f6829e9f-5a19-4dc1-ad76-a9c139661932 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1459 microversion: 2.1 time: 0.244506 Apr 21 14:57:41.705844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 688/1307] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:41 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1459 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:57:42.055717 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6dacb02b-f373-447e-a649-8b90346f356d req-fb309bdb-31a8-4a75-9e7c-b1b087b9e554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce11bbf5-36db-4dfb-9099-f5e0706c001f", "name": "network-vif-deleted", "tag": "1baac0ec-da08-435d-b211-9e2794271ab1"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:57:42.057612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:57:42.057612 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:57:42.067403 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6dacb02b-f373-447e-a649-8b90346f356d req-fb309bdb-31a8-4a75-9e7c-b1b087b9e554 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:42.067908 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6dacb02b-f373-447e-a649-8b90346f356d req-fb309bdb-31a8-4a75-9e7c-b1b087b9e554 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:42.086226 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6dacb02b-f373-447e-a649-8b90346f356d req-fb309bdb-31a8-4a75-9e7c-b1b087b9e554 service nova] Creating event network-vif-deleted:1baac0ec-da08-435d-b211-9e2794271ab1 for instance ce11bbf5-36db-4dfb-9099-f5e0706c001f on hv-cinder-78638 Apr 21 14:57:42.091604 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6dacb02b-f373-447e-a649-8b90346f356d req-fb309bdb-31a8-4a75-9e7c-b1b087b9e554 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039972 Apr 21 14:57:42.092926 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 620/1308] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:57:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:57:42.723183 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:42.723844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:42.732818 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:42.733327 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:42.734202 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:42.734821 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:42.810208 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:42.810716 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:42.811227 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lazy-loading 'fault' on Instance uuid ce11bbf5-36db-4dfb-9099-f5e0706c001f {{(pid=100564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 21 14:57:42.880347 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:57:42.890340 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-22ff1f91-e26f-4cd8-a5ef-2bbee0c1024d tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 200 len: 1231 microversion: 2.1 time: 0.171456 Apr 21 14:57:42.891639 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 689/1309] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:42 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 1231 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:57:43.909892 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0538d4d5-ad51-4016-b8eb-aae7fee19f64 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:43.910693 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0538d4d5-ad51-4016-b8eb-aae7fee19f64 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: ce11bbf5-36db-4dfb-9099-f5e0706c001f] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:43.919724 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0538d4d5-ad51-4016-b8eb-aae7fee19f64 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:43.920268 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0538d4d5-ad51-4016-b8eb-aae7fee19f64 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:43.921143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0538d4d5-ad51-4016-b8eb-aae7fee19f64 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:43.921623 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0538d4d5-ad51-4016-b8eb-aae7fee19f64 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:43.976844 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-0538d4d5-ad51-4016-b8eb-aae7fee19f64 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] HTTP exception thrown: Instance ce11bbf5-36db-4dfb-9099-f5e0706c001f could not be found. Apr 21 14:57:43.977510 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0538d4d5-ad51-4016-b8eb-aae7fee19f64 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Returning 404 to user: Instance ce11bbf5-36db-4dfb-9099-f5e0706c001f could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:57:43.978440 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0538d4d5-ad51-4016-b8eb-aae7fee19f64 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f" status: 404 len: 111 microversion: 2.1 time: 0.073325 Apr 21 14:57:43.979048 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 621/1310] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:43 2021] GET /compute/v2.1/servers/ce11bbf5-36db-4dfb-9099-f5e0706c001f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:57:48.256240 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-1e5df06e-9b44-4621-9a6d-625e865596a1 req-b81069af-2ff1-456a-9c84-4e8eea04cc13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cac6e3-c70e-4a55-aec4-72689e662fc5", "tag": "9f462ccd-688b-4a79-8d55-7cf72be7aeb0"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:57:48.259238 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f5147ba-1d0d-4eea-a6fb-f15d4d150d08 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:48.259901 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f5147ba-1d0d-4eea-a6fb-f15d4d150d08 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:48.261296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:57:48.261296 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:57:48.274805 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f5147ba-1d0d-4eea-a6fb-f15d4d150d08 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:48.278649 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f5147ba-1d0d-4eea-a6fb-f15d4d150d08 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:48.280740 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-1e5df06e-9b44-4621-9a6d-625e865596a1 req-b81069af-2ff1-456a-9c84-4e8eea04cc13 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:48.281143 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f5147ba-1d0d-4eea-a6fb-f15d4d150d08 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:48.281841 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f5147ba-1d0d-4eea-a6fb-f15d4d150d08 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:48.282552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-1e5df06e-9b44-4621-9a6d-625e865596a1 req-b81069af-2ff1-456a-9c84-4e8eea04cc13 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:48.310470 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-1e5df06e-9b44-4621-9a6d-625e865596a1 req-b81069af-2ff1-456a-9c84-4e8eea04cc13 service nova] Creating event network-changed:9f462ccd-688b-4a79-8d55-7cf72be7aeb0 for instance d8cac6e3-c70e-4a55-aec4-72689e662fc5 on hv-cinder-78638 Apr 21 14:57:48.316975 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-1e5df06e-9b44-4621-9a6d-625e865596a1 req-b81069af-2ff1-456a-9c84-4e8eea04cc13 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064604 Apr 21 14:57:48.317780 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 622/1311] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:57:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:57:48.363792 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f5147ba-1d0d-4eea-a6fb-f15d4d150d08 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Going to try to terminate instance {{(pid=100564) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 21 14:57:48.489974 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f5147ba-1d0d-4eea-a6fb-f15d4d150d08 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 204 len: 0 microversion: 2.1 time: 0.240798 Apr 21 14:57:48.491219 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 690/1312] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:57:48 2021] DELETE /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:57:48.500694 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4e046331-d1d2-4c24-93c9-422d35acfc14 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:48.502055 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4e046331-d1d2-4c24-93c9-422d35acfc14 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:48.510586 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e046331-d1d2-4c24-93c9-422d35acfc14 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:48.511203 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e046331-d1d2-4c24-93c9-422d35acfc14 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:48.512320 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e046331-d1d2-4c24-93c9-422d35acfc14 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:48.513458 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e046331-d1d2-4c24-93c9-422d35acfc14 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:49.220127 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4e046331-d1d2-4c24-93c9-422d35acfc14 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:57:49.236526 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4e046331-d1d2-4c24-93c9-422d35acfc14 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1579 microversion: 2.1 time: 0.740656 Apr 21 14:57:49.237466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 623/1313] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:48 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1579 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:57:50.256351 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5a8e0821-be50-4c34-bdfd-dc0e8da3ae9a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:50.258126 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5a8e0821-be50-4c34-bdfd-dc0e8da3ae9a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:50.268812 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a8e0821-be50-4c34-bdfd-dc0e8da3ae9a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:50.269566 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a8e0821-be50-4c34-bdfd-dc0e8da3ae9a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:50.270667 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a8e0821-be50-4c34-bdfd-dc0e8da3ae9a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:50.271397 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a8e0821-be50-4c34-bdfd-dc0e8da3ae9a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:50.559157 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-abe6a8dd-6fa0-4310-b62f-d7d006842208 req-d1e65af0-badd-493e-bd31-2587e2e736a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cac6e3-c70e-4a55-aec4-72689e662fc5", "name": "network-vif-deleted", "tag": "9f462ccd-688b-4a79-8d55-7cf72be7aeb0"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:57:50.560920 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 21 14:57:50.560920 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 21 14:57:50.572922 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-abe6a8dd-6fa0-4310-b62f-d7d006842208 req-d1e65af0-badd-493e-bd31-2587e2e736a0 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:50.573298 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-abe6a8dd-6fa0-4310-b62f-d7d006842208 req-d1e65af0-badd-493e-bd31-2587e2e736a0 service nova] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:50.596552 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-abe6a8dd-6fa0-4310-b62f-d7d006842208 req-d1e65af0-badd-493e-bd31-2587e2e736a0 service nova] Creating event network-vif-deleted:9f462ccd-688b-4a79-8d55-7cf72be7aeb0 for instance d8cac6e3-c70e-4a55-aec4-72689e662fc5 on hv-cinder-78638 Apr 21 14:57:50.601966 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-abe6a8dd-6fa0-4310-b62f-d7d006842208 req-d1e65af0-badd-493e-bd31-2587e2e736a0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047463 Apr 21 14:57:50.602756 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 624/1314] 10.222.0.24 () {64 vars in 1308 bytes} [Wed Apr 21 14:57:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:57:50.610701 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5a8e0821-be50-4c34-bdfd-dc0e8da3ae9a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c134d419e09b4f7da63a8401c01bf6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f31a5650834e49b288140b0ca768c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100564) authorize /opt/stack/nova/nova/policy.py:202}} Apr 21 14:57:50.620568 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5a8e0821-be50-4c34-bdfd-dc0e8da3ae9a tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 200 len: 1393 microversion: 2.1 time: 0.368717 Apr 21 14:57:50.621218 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 691/1315] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:50 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 1393 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:57:51.639836 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bdd314b9-f3b8-43ee-b936-357a807069fa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:51.640806 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bdd314b9-f3b8-43ee-b936-357a807069fa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: d8cac6e3-c70e-4a55-aec4-72689e662fc5] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:51.650069 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdd314b9-f3b8-43ee-b936-357a807069fa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:51.650878 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdd314b9-f3b8-43ee-b936-357a807069fa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:51.651889 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdd314b9-f3b8-43ee-b936-357a807069fa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:51.652466 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdd314b9-f3b8-43ee-b936-357a807069fa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:51.712632 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-bdd314b9-f3b8-43ee-b936-357a807069fa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] HTTP exception thrown: Instance d8cac6e3-c70e-4a55-aec4-72689e662fc5 could not be found. Apr 21 14:57:51.713199 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bdd314b9-f3b8-43ee-b936-357a807069fa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Returning 404 to user: Instance d8cac6e3-c70e-4a55-aec4-72689e662fc5 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:57:51.715080 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bdd314b9-f3b8-43ee-b936-357a807069fa tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5" status: 404 len: 111 microversion: 2.1 time: 0.078948 Apr 21 14:57:51.716376 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 625/1316] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:51 2021] GET /compute/v2.1/servers/d8cac6e3-c70e-4a55-aec4-72689e662fc5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:57:52.847936 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b856323e-3184-4861-bb91-41478e779168 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:52.848485 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b856323e-3184-4861-bb91-41478e779168 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100564) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:52.857177 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b856323e-3184-4861-bb91-41478e779168 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:52.857684 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b856323e-3184-4861-bb91-41478e779168 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:52.858622 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b856323e-3184-4861-bb91-41478e779168 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:52.859114 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b856323e-3184-4861-bb91-41478e779168 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100564) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:52.911760 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-b856323e-3184-4861-bb91-41478e779168 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] HTTP exception thrown: Instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 could not be found. Apr 21 14:57:52.912439 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b856323e-3184-4861-bb91-41478e779168 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Returning 404 to user: Instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 could not be found. {{(pid=100564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:57:52.913353 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b856323e-3184-4861-bb91-41478e779168 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 404 len: 111 microversion: 2.1 time: 0.069796 Apr 21 14:57:52.914130 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 692/1317] 10.222.0.24 () {58 vars in 1229 bytes} [Wed Apr 21 14:57:52 2021] DELETE /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:57:52.922771 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34ea9c3c-4926-49c9-bd14-594bbc7e9f80 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:52.923424 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34ea9c3c-4926-49c9-bd14-594bbc7e9f80 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] [instance: 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 21 14:57:52.932001 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34ea9c3c-4926-49c9-bd14-594bbc7e9f80 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:52.932505 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34ea9c3c-4926-49c9-bd14-594bbc7e9f80 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:52.933352 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34ea9c3c-4926-49c9-bd14-594bbc7e9f80 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 21 14:57:52.933842 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34ea9c3c-4926-49c9-bd14-594bbc7e9f80 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Lock "ee5823f9-95bd-47be-a7d6-f14717896ffb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 21 14:57:52.988350 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-34ea9c3c-4926-49c9-bd14-594bbc7e9f80 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] HTTP exception thrown: Instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 could not be found. Apr 21 14:57:52.989023 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34ea9c3c-4926-49c9-bd14-594bbc7e9f80 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Returning 404 to user: Instance 8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 21 14:57:52.989931 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34ea9c3c-4926-49c9-bd14-594bbc7e9f80 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58" status: 404 len: 111 microversion: 2.1 time: 0.071297 Apr 21 14:57:52.990810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 626/1318] 10.222.0.24 () {58 vars in 1226 bytes} [Wed Apr 21 14:57:52 2021] GET /compute/v2.1/servers/8b886ca0-c1b7-4e12-a979-b3ddf5b77f58 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:57:54.471976 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8729d79a-1987-4700-b9ea-3b30a4c7a9f9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] Calling method '.version_select at 0x7f19e05e5ae8>' {{(pid=100564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 21 14:57:54.492885 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8729d79a-1987-4700-b9ea-3b30a4c7a9f9 tempest-TestVolumeBootPattern-2089675180 tempest-TestVolumeBootPattern-2089675180-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1319973046" status: 202 len: 0 microversion: 2.1 time: 0.025076 Apr 21 14:57:54.493498 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: [pid: 100564|app: 0|req: 693/1319] 10.222.0.24 () {58 vars in 1253 bytes} [Wed Apr 21 14:57:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1319973046 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:58:35.080337 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:58:35.081040 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 14:58:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 15:00:20.330540 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:00:20.331196 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 15:00:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 15:00:20.651626 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:00:20.651929 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 15:00:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 15:00:38.437210 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:00:38.437810 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 15:00:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 15:00:40.863480 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:00:40.864429 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 15:00:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 15:00:50.811301 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:00:50.811977 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 15:00:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 21 15:01:55.103043 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:01:55.103682 dv-cinder-786385-2-iscsi devstack@n-api.service[100561]: Wed Apr 21 15:01:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!